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FOREWORD 



One of the goals of Air Force Electronic Systems Division is the develop- 
ment of a technology for automated training subsystems which could be built in- 
to future Air Force information systems. Task 691709, Automated Training for EDP 
Personnel, under Project 6917, Command Management Data Systems Software, was es- 
tablished to develop that technology and apply it in experimental computer-direct- 
ed training subsystems in Air Force computer-based information systems. 

This final report describes one such subsystem which was developed for use 
in the Air Force Phase II Base Level System. Dr. Sylvia R. Mayer, ESMDA, served 
as Air Force Task Scientist for this effort which was accomplished between July 
1967 and December 1969 under Project 6917. 

This work was supported by Contracts F19628-C-0427 and F19628-68-C-0399 
with System Development Corporation. Dr. John W. Cullen was Principal Investi- 
gator with Mr. Richard S. Cowdery, Mr. Alfred K. Butler and Mr. Lawrence Harris. 
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Breeze, Sheppard Technical Training Center, and members of his staff: Mr. Charles 
Pealor, TSgt Hackworth, SSgt Beaver; and Captain Warren Suzuki, Hq Air Training 
Command. 
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ABSTRACT 



This report describes a study concerned with the design, development 
and evaluation of an integrated Computer -Directed Training Subsystem 
(CDTS) for the Air Force Phase II Base Level System. The development 
and evaluation of a course to train computer operators of the Air Force 
Phase II Base Level System under CDTS control is also described. De- 
tailed test results for validation of the computer operator course and 
Formal Qualification testing of the CDTS are presented. Conclusions and 
recommendations with respect to the current CDTS recommendations for 
additional capabilities and further implications are discussed. 
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Section I 



INTRODUCTION 

This final report describes a two and one-half year study concerned with 
the designing, development and evaluation of an integrated computer- 
directed training subsystem (CDTS) for the Air Force Phase II Base Level 
System. The purpose of this training subsystem is to finish on-the-job 
training for data automation, staff -users and management personnel in 
the operation and use of the base level system. 

In addition to designing, developing and evaluating the CDTS the develop- 
ment and evaluation of a course to train computer operators of the Air Force 
Phase II Base Level System operation under CDTS control is described. 

The Phase II Base Level Project is an Air Force-wide effort to provide 
automated management systems at the base level. Equipment presently 
installed at base level will be replaced by Burroughs B 3500 computer 
systems. The B 3500 system is a modular system, featuring massive im- 
mediate access (disk) storage and remote communications terminals. Its 
Master Control Program is designed to facilitate on-line user interaction 
with programs from the remote terminals. 

The CDTS functions as other subsystems of the Phase II System. It conforms 
to the standards and requirements of the Phase II System, without disrupting 
normal system operations. 

The application of the CDTS may vary with users of the Phase II Base Level 
System. The program as developed is a multi-purpose, user-oriented, inter- 
active, subsystem which permits the construction and presentation of new 
lesson material or modifications to existing material without requiring 
programming changes. 

Lessons may be designed and constructed to satisfy a variety of training 
requirements (e.g., initial training in a specific specialty, upgrade train- 
ing, or proficiency training). The program presents the requested lesson 
at a remote communication terminal for individual on-line training sessions. 
When appropriate, computer material is augmented with off-line exhibits and 
instructional material. 

Although the program has been designed to be compatible with other Phase II 
Base Level System applications, CDTS was initially used to construct and 
validate a computer operator's course. Students at the Sheppard Technical 
Training Center were used as subjects during validation. 

Contents of this report . 

Part II of this report describes: (1) the Burroughs B 3500 system in which 
the CDTS operates, (2) CDTS itself, and (3) the Computer Operator's Course. 



Part III discusses the testing and evaluation phase of the study conducted 
at Sheppard Technical Training Center (STTC) Texas. 

Part IV contains conclusions and recommendations regarding the future 
development and application of the CDTS. 

Part V indicates the personnel who have been involved with the project. 

Part VI indicates project related documentation. 

Appendices: 

A - Flow Diagram of the CDTS. 

B - Computer Operator's Course Outline, Objectives and a sample of 
course material from both the course designer and trainee stand- 
point. 

C - Phase I and II data analysis, USAF Aptitude Test Scores, and sample 
data collection forms. 

D - Formal Qualification Testing Results 



Section II 
PROJECT SOFTWARE PRODUCTS: CDTS AND COMPUTER OPERATOR'S COURSE 



Two software systems were developed and tested during this two and one- 
half year study. The first consists of a computer-assisted instruction 
(CAI) author language and associated computer programs. This combines 
to form the CDTS. The CDTS and PLANIT (Programming Language for Inter- 
active Teaching) was used to generate the lesson material which consists 
of 13 lessons for training computer operators for the B 3500 system. The 
CDTS also was used to present the lessons to trainees via a remote terminal 
device. The CDTS was written in COBOL and compiled for execution in the 
B 3500 system to operate under the control of the Master Control Program 
(MCP) during its various modes. 

This section describes the B 3500 system, presents a description of the 
CDTS and outlines the CAI lessons produced, 

A, B 3500 System Characteristics 

The B 3500 system as depicted in Figure 1, is a modular system, in- 
corporating monolithic circuitry, high-speed core storage, massive 
immediate access (disk) storage, and remote communications terminals. 
It's MCP is designed to facilitate on-line user interaction with pro- 
grams from the remote terminals. The following briefly describes 
the major components of the system. 

1. Central Control. All peripheral unit operations are independent 
of each other and of the processor; therefore, any combination of 
simultaneous input-output can be overlapped with program execution. 
When a particular device wants a memory access, it makes an access 
request as soon as all requests from higher priority devices have 
been satisfied. 

2. Core Memory* Core memory requires a memory cycle time of one 
microsecond for every two bytes accessed. 

3. Address Memory. Address memory is an array or table of 24 words 
(two bytes to the word), expandable in increments of 12 words. 
Eight words are assigned to each I/O channel in the system. During 
execution, the processor addresses core memory with words from 
address memory so that memory accesses are not required for infor- 
mation relative to the command itself during execution; that is, 
accesses during the execution phase are for data only. A word 
from address memory requires an access time of only 100 nanoseconds. 

4. Input/Output System. The input/output system consists of the 
peripheral control units and their related input/output channels 
and operates independently of the processor. The processor issues 
a command to the I/O system and then proceeds independently until 







30fJVkOX3 3JV1 OV.'J 






o 



LU 




a £ w 




-1 — 




■ »-*•* 


O f~ (U — , 




o>- UJ A 


Uj*O h 




UJtOk 


UJ 


ss 




3 s 




tLSZ* 




*■*•«:* 


UOldVQV 




WOldVOV 


ja 




iO 




tm»'H3X3 JO 




2^ 




— ^ 


i„ 


U. (E r- 




u_ X r. 


8 B 






o 




u 



O «n uj <£ 
(E _j > Q- 

*r ujuj _j 
Si 9 



w 

rS 



UJ «n 



W 



1 


x - 




l^j 


S g O 


< P 


a * 



JL 




'/> 


ce 




UJ "» 


o ^ 


•" F ™ 

20, m 


— j n s» 


~ -J ** 


J- */> ** 


°-8d 


6p.J 

— Q- ui 


UJ — o 


t K O 


z -* 5 


o £ o 


D 2 






I- CM*** 

Z <*> .. _ 

o , > a. 



OS 




UJ 




h- <? 




z o 








e ei 




CL o» 


> w 


Oj 

a uj 


* o 


o 


o o 




CO *z 


o 


> 


z 


UJ 




it 







OS 




UJ 




H CM " 




ZA ~ 




o o 


-> 




to P d 




> a z 




UJ 




s: 



o 



D 
UD 

o 

B 
a 

■U 
CO 

CO 

O 
O 

m 

en 

PQ 



8 



Pn 



the I/O system completes the operation and interrupts and any or 
all I/O channels may operate simultaneously. The I/O system time 
shares core memory and address memory with the processor, under 
control of the central control unit. There is an I/O channel and 
a peripheral control for each peripheral unit, or group of units 
of the same type. 

The Processor. The processor contains the arithmetic units and the 
logical controls of the system. Object programs are floated in 
memory through use of a base register thus allowing several programs 
to be resident in memory at one time. The MCP will set the base 
register for one program, retrieve it, and turn control over to 
that program. After handling an interrupt, the MCP may reset the 
base register and turn control over to another program. 

Operational States . The central processor always operates in one 
of two states: The Normal State, in which user programs are executed, 
or the Control State, in which the functions of the MCP operating 
system are performed. A powerful interrupt system causes the pro- 
cessor to enter the Control State and branch to the MCP whenever 
conditions such as completion of an I/O operation, memory parity 
error, memory address error, and clock interrupt occur. I/O opera- 
tions can be initiated only when the central processor is in the 
Control State, and their execution is directed by the MCP. 



7. Memory Protection. Base and limit registers are used to provide 
memory protection—an essential feature for multiprocessing. An 
attempt to go out of memory allocated will result in the suspension 
of the offending program. 

8. Disk Files. The modular random storage disk modules provide the 
capacity of 10 or 20 million bytes each. The average access time for 
a module is 20 milliseconds, and the peak transfer rate is 218,000 
bytes per second. Disk File Exchange units permit multichannel 
access of disk units. 

9. Remote Terminal Communications. A multiprocessing environment 
is provided, under which up to ten users of the system may simul- 
taneously interact with their programs from remote keyboard/printer 
terminals . 

B. Description of the CDTS 

The CDTS as designed permits the establishment of a CAI capability 
within the Phase II Base Level System. 



Computer-assisted instruction (CAI) can be defined as using the 
capabilities of a computer to present instructional material to 
trainees who interact with the computer via a remote terminal device. 
A computer-assisted instructional system has several basic features: 
It is independent of the particular type of lesson; the material 
operates within a computer and there is continual interaction between 
the user at the remote communication device and the computer. 

The CDTS is a general-purpose training system consisting of a user 
oriented language and a set of computer programs which permit course 
designers to construct material for a variety of training purposes. 
This material may be input to the system in an on-line mode from a 
remote terminal, or constructed from a card input to a batch processing 
program. Once constructed, lesson material is saved onto disk storage 
or tape for future presentation to trainees. Lessons stored on tape 
can be selectively loaded onto disk storage to fulfill specific train- 
ing session requirements. Records of trainee performance are main- 
tained by the system for data processing and analysis. 

To accomplish these training objectives, the CDTS is divided into five 
basic components. (Refer to Figure 2 - CDTS Functional Block Diagram). 

1. The Control Function: 

a. Interfaces with the B 3500 MCP and Data Communication Handler 
(DCH). 

b. Outputs the message "ENTER INITIAL COMMAND TO CDTS 11 as the 
first operation of the system. 

c. Interrogates all inputs from the remote communication terminals. 

d. Interprets all system commands. 

e. Establishes the user within the requested mode of lesson build- 
ing or lesson execution, 

f . Maintains status of each user within a given lesson enabling 
several users to interact simultaneously with one or more 
lessons. Also, it allows one user to switch from executing one 
lesson to executing a different lesson and back to the first 
lesson. 

2. The Lesson Building Mode: 

a # Permits a real-time construction of selected lesson material 

by a course designer familiar with the training system language 
and special conventions contained therein. The course designer 
can commence to build a lesson or retrieve an existing lesson 
and continue to insert content material. Selected material is 
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inserted and processed by the training program as "frame" units. 
Each frame is further segmented into groups and these groups 
are composed of individual lines of information. A lesson is 
therefore, a series of frames sequenced as designed by the 
course designer. 

A sequence of related lessons can be used to form a course. 
There is no system limit upon the number of lessons that may 
be used to comprise a given course. 

A lesson may be used within more than one course, when appro- 
priate. For example: a lesson on number systems might be 
included in a general programming course as well as in a course 
dealing with an introduction to mathematical theory. The course 
designer has the responsibility of linking together the lessons 
within his course by either branching the trainee to the next 
lesson in the course sequence, or by providing the trainee with 
the information necessary for him to enter the next lesson. 

b. Provides frame type selection by the course designer to meet 
the varying needs of course construction. The frame types 
available for selection are the: 

1) Question frame--normally used to present lesson content 
material to inform or require a constructed response. 

2) Multiple-choice--normally used to present lesson content 
material and alternate answer-choices for selection. 



3) Decision frame --normally used to establish conditional 
statements which are executed depending upon a response 
to one or more frames. 

4) Copy frame--a lesson building aid rather than a different 
frame type which instructs the program to copy any previously 
built frame. 

Each selected frame is automatically numbered sequentially by 
the program. 

Provides on-line assistance to the course designer after the 
selection of a frame type. The assistance is in the form of 
output messages which inform the course designer of the type 
of information to enter within each group of the frame, 
(e.g., label frame, insert textual material, specify answers, 
and actions to institute based upon the processed response). 



d. Provides a facility for on-line checkout and quality control 
of constructed material by the course designer. The course 
designer may enter the Lesson Execution Mode from the Lesson 
Building Mode and have his completed lesson material presented 
as though he were in a training status. A record is maintained 
of his responses and sequence through the lesson frames. In 
this role, the course designer performs quality control on the 
lesson logic and material presentation. Full training system 
privileges are available to the course designer in this mode, 
whereas, a trainee is confined to the parameters of the lesson. 

e. Enables the course designer to preserve completed lesson 
material onto the disk. The program requires an identification 
from the course designer. If the identification is legal, the 
program associates the identification with the lesson affording 
a measure of protection against unauthorized changes or uses. 

f . Permits the linking of two or more lessons to form a course of 
instruction. 

g. Modification of lesson material. 

1) Permits the on-line printout of selected lesson material 
by the course designer for visual quality control. To 
avoid system degradation due to excessive Input/Output 
operations, only a range of three frames per request is 
printed on-line. However, the entire lesson can be 
printed off-line. 



2) Enables the on-line modification of lesson material by 
the course designer. 

o Insertion- -the training system determines the level of 
insertion desired; frames, group or line, and whether 
the insertion is to occur within existing material or 
be added to the lesson material. If a single line is 
specified, the program prints out the requested line 
for easy reference and changes are entered. The new 
line of information replaces the old line in the lesson. 

o Deletion- -the training system determines the level of 
deletion desired; frames, groups within frames or lines 
within groups and removes the material from the lesson. 



The Lesson Execution Mode: 

a. Permits the retrieval of a lesson by the course designer or 
trainee. The program requires an insertion identification 
which is compared against the identification associated with 
the lesson. The results of the identification comparison 
dictate whether the program treats the user as a course 
designer with full program capabilities or a trainee confined 
to the parameters of the lesson. 

When the user is a trainee, the program positions the lesson 
to the proper frame depending upon whether the trainee is 
starting or continuing the lesson. The course designer can 
execute the lesson from any legal frame and has complete 
freedom to traverse the frames within the lesson. 

b. Allows the trainee control over the presentation rate of 
lesson material, subject to the constraints of the MCP/DCH 
and the course designer's intent. 

c. Contains service functions (PHONETIC comparison, KEYWORD match, 
or ORDER permutation) for evaluating inserted answers which 
depart from anticipated responses as programmed by the course 
designer. These service functions operate at the course 
designer 1 s discretion. 

1) PHONETIC--causes all words in both the course designer's 
answer(s) and the trainee's response(s) to be encoded by 
the training program and the encoded messages compared 
for a possible match. This permits the misspelling of 
words by the trainee. If a misspelled word is within the 
encoding criteria, the response is considered correct by 
the program. 

2) KEYWORD- -causes the program to disregard everything in the 
trainee's response except that which the course designer 
has specified to be matched. Extraneous information may be 
included as part of the response without penalty. When 
this service function is inoperative, the program makes a 
character set by character set (word by word) comparison 

to determine if the trainee's response matches the course 
designer's answer. No extraneous words may appear in the 
trainee's response for a match to occur. 

3) ORDER--causes the program to ensure that the word(s) 
specified by the course designer appear somewhere in the 
trainee's constructed response- -independent of order. 
When this service function is inoperative, the program 
treats the trainee's response as a standard English state- 
ment. The words in the response must be in the same order 
as specified by the course designer. 
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Performs automatic evaluation of trainee responses. Inserted 
answers and lesson specified answers are evaluated for possible 
matches . 

Outputs immediate feedback to the trainee at the end of his 
response. Based upon the answer matching process the program 
selects the appropriate type of feedback/action. 

1) Feedback — enables the course designer to specify appropriate 
messages based upon trainee response. If no message is 
specified, the program randomly chooses one from a table 
containing positive and negative comments. After printing 
the message, the program branches to the next frame in 
sequence or follows a subsequent command. 

2) Repeat—permits the course designer to specify a feedback 
message requiring another response. If none is specified, 
the program prints "WRONG TRY AGAIN 11 and waits for another 
response. 

3) Correct- -ins tructs the program to print "THE CORRECT ANSWER 
IS" followed by the answer indicated as correct by the course 
designer. 

4) Branch — permits the interruption in course sequence. The 
program can be instructed to branch to another frame or a 
different lesson. 

Detects illegal actions by the trainee and initiates appropriate 
recovery cycles. 



Dynamically sequences the lesson material as a result of 
trainee responses and the design of the lesson. 

Permits the continuation of a lesson at an appropriate entry 
point after a lesson session interruption. 

On-line establishment and maintenance of trainee performance 
records. The program updates the trainee's record after pre- 
senting each frame and evaluating the inserted response. The 
program preserves the trainee's record upon completion of the 
lesson or when the command to terminate the training session 
is inserted. The trainee can discontinue a training session 
and continue from the proper point in the lesson at a sub- 
sequent session. 
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4. The Trainee Record Processing Mode: 

a. Stores specific data items. The program stores historical 
records of the trainee's path and answers through the 
lesson within the trainee record file. 

b. Off-line processing of individual trainee records. 

c. Off-line printout of stored information in the format pre- 
scribed- -history (the sequence the trainee took through the 
lesson) and/or summary data for individual trainees. 

5. The Off-Line Lesson Building Mode: 

a. Processes a keypunched deck containing lesson material in a 
prescribed format. 

b. Examines the lesson deck for format errors. 

c. Constructs the lesson onto disk storage, replacing any other 
version of the lesson. 

d. Outputs a listing of the lesson contents, along with notations 
of any detected errors. 

6. The Selective Library Capability 

a. Permits the building of lessons from card input into one or 
more "library 11 tapes. 

b. Permits the selection of lessons from one or more library 
tapes to be loaded onto disk storage for use during a train- 
ing session. 

c. Minimizes disk storage requirements needed for a specific 
training session by constructing a new lesson file. Lessons 
stored on disk from previous training sessions and not in- 
cluded within the current lesson file are removed, thereby 
releasing disk storage for additional uses. 
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C. Computer Operator's Course 

1. Course Development 

The computer operator's training material can be segmented 
logically into two major areas: 

o General computer programming information which is non-machine 
specific but considered appropriate foundation material for a 
computer operator, 

o Specific information which is considered necessary for a 
person to develop the skills to properly operate a B 3500 
computer. 

The development of this course material was in programmed instruc- 
tional format which was then converted into a computerized format 
for use within the Phase II system. This required several steps. 
The general computer programming information was prepared first. 
This consisted of the instructional programmers interacting with 
the subject matter experts to formulate the overall course out- 
line for lessons 1 through 8. From this outline, the creation of 
terminal behavioral objectives and criterion tests items were 
prepared. This material was reviewed by appropriate Air Force 
Agencies and modifications and alterations were made as required. 
Actual frame construction for these lessons was then instituted. 
This process was repeated for the B 3500 specific information 
and comprised lessons 9 through 13. (Appendix II contains the 
complete course outline and objectives). 

These 13 lessons were then converted, entered and logically 
verified on the System Development Corporation's AN/FSQ-32V 
computer via the computer assisted Instructional language, PLANIT 
(Programming LAN gu age for ^Interactive Teaching) . 

PLANIT is also a general -purpose computerized system which operates 
in four basic modes: Lesson building, Editing, Execution and Cal- 
culation. PLANIT allows the course designer to enter course content 
into the computer, via a teletypewriter and to store the material 
in designated sequences. The course designer may use a variety of 
lesson frame formats and review, edit, and revise the course material 
as necessary. 

Only those capabilities in PLANIT which were compatible with the 
execution mode of the CDTS were used in the conversion of the 
Computer Operator's Course, Each lesson was entered on-line 
via a teletypewriter linked to the AN/FSQ-32V. The lessons 
were sequentially connected by the course designer in conformance 
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with the lesson material specifications. The output of the 
PLANIT-cons true ted lesson material was decks of cards with each 
card corresponding to a line of lesson input. These card decks 
served as input to the Off-line Lesson Building Function of the 
CDTS and were then available for execution on-line via the Execution 
Mode of the CDTS. 

Course Description 

a. General 

Lesson 1 through 8 serve as material to orient the trainee to 
the information and concepts in the area of general programming 
and can be used apart from any specific computer system or 
complex. In contrast, lessons 9 through 13 present information 
concepts relating specifically to the Burroughs B 3500 computer 
system. 

b. Specific 

Lesson 1 - Introduction to Computer Concepts 

This lesson is designed to present to the trainee 
the basics upon which he begins to build his data 
processing knowledge. Several data processing 
terms (data base, program, hardware, software, etc.) 
and abbreviations (DP, EDPM(E) , EAM, etc.) are 
presented. A historical overview, computer class- 
ifications and the three generation types of computers 
are indicated. 

Lesson 2 - Number Systems 

In this lesson the trainee is exposed to the follow- 
ing number systems: Binary, Octal, Decimal, and 
Hexadecimal. The concepts of expansion, complimenta- 
tion, as well as addition and subtraction for the 
above number systems are presented. Conversions are 
made from one system to another regardless of the 
system. Definition of terms within this leseon in- 
clude bits, triads, and quadrads, etc. Primary 
emphasis of instruction within this lesson is directed 
toward the hexadecimal number system. 

Lesson 3 - Basic Computer Components 

The trainee is given the descriptions and relation- 
ships between the following computer components: 
storage, arithmetic unit, control and I/O units. 
Terms introduced within this lesson include registers, 
word locations , memory buffering, parity, bytes , etc. 
The cycles of a computer (machine, instruction and 
execution) are covered in detail, 
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Lesson 4 - Computer System and Peripheral Units 

This lesson presents the types of storage devices 
associated with a computer system. This includes 
punched cards , magnetic tape , paper tape , drums 
and disks. The criteria is given for evaluating 
these various storage devices as to capacity, 
speed, reliability, cost, power requirement and 
physical size. Input/output configurations are 
noted along with the types of access. The re- 
maining material covers various aspects of computer 
timing. 

Lesson 5 - Data Representation 

The trainee is provided explanations and exercises 
concerning the use of such terms as binary, BCD, 
EBCDIC, bytes , print images , etc. In addition, 
the representation of fractional numbers (fixed 
versus floating) is presented. 

Lesson 6 - Program Design 

This lesson indicates the various components which 
interact and their function in the establishment of 
a system. The use of the flow chart within a program 
design is emphasized. This includes the types of 
flow charts (micro versus macro) , when used and by 
whom, flow conversions (e.g., branch, halts, etc.) 
and the standardized symbols employed. The decision 
table and other related methods are also presented 
to the trainee. 

Lesson 7 - Programming Languages 

This lesson presents to the trainee the concepts 
and uses of assemblers, translators, compilers, 
etc. Explanations include the advantages and 
disadvantages of MOL, Symbolic code and POL's, 
Generalized coverage of the instructional classes 
(arithmetic, sequence control, data movement, 
comparison, I/O) are presented. The trainee is 
also provided a cursory review of several of the 
more established and widely used POL 1 s with special 
emphasis directed toward FORTRAN and COBOL. 

Lesson 8 - Operating Systems 

The trainee is exposed to the purpose and general 
description of several types of operating systems. 
The examination of time-sharing (advantages and 
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disadvantages) and the related terms of real-time, 
batch processing, turnaround, supervisory time, 
job-shop, etc. are considered* Also, the two basic 
modes of operation (background versus foreground) 
is presented to the trainee. 

Lesson 9 - Introduction to the B 3500 System 

This lesson provides the trainee with basic precepts 
and configuration of the B 3500 system. An intro- 
duction to the types of hardware which comprise the 
system and the general functions performed by the 
operating system, is outlined. In addition, a brief 
description of the core memory and word configuration, 
internal processing capabilities, data presentation 
selectable codes, and the on-line operating consoles 
are presented. 

Lesson 10- Peripheral Equipment--Low Data Rate 

The card reader, punch, and line printer are presented 
in detail to the trainee. The user logic for the 
operation of these three pieces of equipment is pre- 
sented along with a description of all control panel 
switch/indicators. At appropriate stopping points 
within this lesson the trainee is directed to perform 
!! hands on 11 training and demonstrate a level of mastery 
with each unit. This includes operating the card 
reader and punch by inserting a test deck, and re- 
covering from several error conditions. 

Lesson 11- Peripheral Equipment- -High Data Rate 

This lesson considers in detail the tape units and 
disk units/modules associated with the B 3500 system. 
Step by step user actions are presented for various 
tape unit actions. The rationale of disk storage 
and use is given in addition to the various types of 
disk construction. As in lesson 10, the trainee is 
required to perform "hands on !! training and demon- 
strate a prescribed level of mastery by loading a 
tape and correcting various error conditions. 

Lesson 12- Operators Console and Supervisory Printer /Keyboard 

This lesson introduces the trainee to the equipment 
by which direct interaction with the operating system 
and all other on-line systems is effected. All button 
actions and operating procedures are given for the 
SP0, operators console, as well as the control panel. 



16 



The step by step procedures for loading the 
operating system either by the Normal or Universal 
load along with the conditions which differentiate 
each type of load are detailed. 

Lesson 13- System Software and Intervention 

This lesson was divided into two parts. In Part I 
the trainee is exposed to several definitions and 
concepts which are pertinent to B 3500 system 
operation. This includes scratch tape, system log, 
file opening, disk directory table, and break-out. 
The remainder of the material addresses itself to 
the system load procedures (simple versus cold 
start) with particular emphasis upon the card struc- 
ture for each type of system load. 

The various kinds of program and parameter control 
card are discussed as to their function and when 
required within a specific system load control 
deck. The type of system start required because 
of the particular status of the system or to effect 
a particular condition is also presented. 

In Part II, the trainee is exposed to the three 
major categories of output messages (errors, require- 
ments and results to input queries) generated by the 
operating system. This is followed by indicating 
the techniques and procedures of introducing data 
and program files into the system. Here the emphasis 
is upon the source and type of data (card and pseudo 
card decks, and SPO input messages) and the schedul- 
ing and operation of programs within the schedule 
versus the mix. Next, the capabilities provided to 
an operator to interact and control the system 
operation are considered. This includes the type 
and procedures for inserting control information, 
enabling or disabling system options, performing 
maintenance of the system log, interrupting and 
restarting as well as suspending and reinstating 
operating programs. The remainder of the material 
considers program failure and debugging. 

3. Lesson Strategy 

The basic strategy as indicated in Figure 3 is the same for all 
lessons. The student is permitted the option of taking the lesson 
material or attempt to by-pass the material contained within the 
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FIGURE 3 Lesson Logic for the Computer Operator's Course 
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specific lesson by successfully negociating a prerequisite test. 
The prerequisite test is lesson specific and is not a criterion 
test which is contained at the end of each lesson. 

At selected points within the prerequisite test, it is determined 
through decision statements the trainee's position within a pass/ 
fail criterion. Tolerable errors approximate 10% for each lesson. 
If the condition is--PASS, as determined by his correct responses 
to the test items, the trainee proceeds to the next subset of the 
prerequisite test. However, if the condition is--FAIL, as indicated 
by errors exceeding the prescribed criteria, the trainee is un- 
conditionally branched to the starting point in the lesson material. 

If the trainee demonstrates mastery of the material contained 
within the lesson by successfully passing the prerequisite test, 
he is branched to the next lesson within the computer operator's 
course. 

At the completion of the lesson material the trainee may review 
all or selected parts. He will then be exposed to the criterion 
test for that lesson. 

If the trainee fails to meet the lesson standards, he is automatically 
branched to appropriate review material. Upon completion of this 
material the trainee is returned to the departing point in the criterion 
test. 

The trainee must demonstrate mastery over these test items before he 
is allowed to advance to the next lesson within the computer operator's 
course. 
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SECTION III 



TESTING AND EVALUATION 



The production of the two software products: The CDTS and the Computer 
Operator 1 s Course required that two distinct testing operations be con- 
ducted at the Sheppard Technical Training Center (STTC) , Sheppard Air 
Force Base. For each software product a test plan was prepared which 
established the general and specific requirements and set forth the 
necessary procedures to effect the accomplishment of the particular test.* 
A description of the Computer Operator's Course validation effort and re- 
sults will be presented followed by the Formal Qualification Testing of 
the CDTS with the results of that effort. 

A. Validation of the Computer Operator 1 s Course 

The validation of the Computer Operator's Course was conducted at 
the Sheppard Technical Training Center using the operational 
Burroughs B 3500 computer system and the CDTS. 

The usual three phase validation sequence (i,e., individual, small 
group, and field testing) was reduced to a two phase sequence (de- 
signated Phase I and II) to facilitate validation within the allocated 
time period. Phase I and II were accomplished during the time periods 
of 4-24 March and 28 April through 19 May 1969 respectively. 

1. Test Conduct 
a. Phase 1 

Phase 1 combined the traditional individual and small group 
validation techniques and was termed: GIVE (Group - Individual 
Validation Environment) . 

Six (6) Air Force trainees and two validators who were assisted 
by two Air Force personnel serving in the capacity as monitors 
comprised the manpower for the Phase I validation. The trainees 
were divided into 2 teams of 3 men each and were observed by 
one validator/monitor team. 

Eight (8) Frieden Remote Terminals were available for use to 
present the lesson material to the trainees and permit the 
entering of answers on-line for processing by the Execution 
Mode of the CDTS. These Remote Terminals were situated in 
two separate locations with one terminal serving as a backup 
in the event of any malfunction as indicated in Figure 4. 



See project documentation for appropriate references , 
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As indicated in Figure 4, the monitor directed all of his 
attention toward a specific trainee whereas the validator 
attempted to monitor one of the two remaining trainees. 
The third trainee was monitored by the validator on an-as- 
needed basis. To gain rapport, and reduce possible bias, the 
validator and monitor systematically rotated among the three 
trainees for each computer session. In addition, the trainees 
made by-weekly intra-and inter-building positional rotations. 

Prior to the initial on-line administration of the lesson 
material, the six Air Force trainees were briefed by contractor 
and appropriate Air Force personnel as to the nature of their 
task, schedule of activities and the attendant procedures. 
Lesson material was then selected for presention by the 
execution mode of the CDTS in accordance with the schedule 
as set forth in the test plan. 

Access to B 3500 hardware (e.g., Supervisory Keyboard/Printer, 
Tape Units, Card Punch, etc.) was necessary to complement the 
material contained within lesson 9 through 13. 

During the individual phase of the self-paced GIVE technique, 
the validator/monitor teams recorded not only all areas of 
difficulty (both observed and stated) within the lesson material 
but also noted all overt mannerisms which provided the stimulus 
for further exploration. 
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Within the small group phase of the GIVE technique the trainees 
were instructed to record on the forms provided pertinent comments 
regarding the lesson material.* The validator/monitors were 
available to reslove these areas or questions deemed crucial by 
the trainees. This limited amount of activity did not appear to 
curtail the effectiveness of the validator/monitor with the 
trainees during a specific computer session. 

Upon culmination of each daily session, (Mon-Fri - 1800-2300 
hours and Sat-Sun - 0800-1130 hours), all trainees and val- 
idator/monitor teams met for a one hour critique session. 
During these critique sessions additional comments and suggestions 
were elicited from the trainees concerning problem areas as 
well as suggestions for additions and/or deletions to the lesson 
material. Based upon the information gathered during the on-line 
computer sessions as well as from the critiques, the validators 
performed appropriate on-line editing of the lesson material. 



b. Phase II 

Phase II was a field test conducted by Air Force personnel 
with assistance from contractor personnel. The environment 
was structured to simulate a quasi-classroom setting. As 
in Phase I, personnel were selected to serve as permanent 
monitors for the entire validation activity. Additional 
Air Force personnel were scheduled to augment this permanent 
team and were rotated on a weekly basis. Contractor personnel 
involved in the Phase I validation also participated in 
Phase II. 

Twelve (12) Air Force trainees were selected to participate in 
the Phase II validation activity. 

The 8 Frieden Remote Terminals used as trainee devices in 
Phase I remained in the same location initially and retained 
their relative number. On 14 May, remote terminal #4 was 
moved to another room and redesignated #2. Remote terminals 
#2 and #3 were redesignated #3 and #4 respectively. 

As in Phase I, the trainees were briefed by Air Force personnel 
as to the nature of their task, schedule of activities and the 
attended procedures. The major emphasis in Phase II was that the 
trainees should work unassisted at the remote terminals without 
intervention by Air Force or contractor personnel. When required, 
trainees were assisted by Air Force or Contractor personnel when 
system or subsystem malfunction interrupted normal trainee pro- 
gressions through lessons. 



* See Appendix III Table 13 and 14 for examples of the forms provided to the 
trainees . 
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Each trainee for Phase II was given a number for identification 
purposes and rotated among the remote terminals according to 
the master schedule as indicated on the following page. 

Total time allocated for each trainee per night was four hours. 
Each trainee remained at a particular remote terminal for an 
hour and then either moved to another remote terminal or went 
on a forced break for an hour. 

Maximum time allocated for lesson execution before a forced 
break occurred was two hours. The trainee had to execute 
the second hour of a two hour block of lesson execution time 
at a different terminal. 

The monitors for this phase remained at specific terminals 

for the entire nightly session. No rotating of monitors 

during Phase II was required. The trainees did, however, 

rotate between Burns Hall (Bldg. 920) and Building 1060 

on a daily basis. The daily schedule was Mon-Fri - 1800-2400 hrs, 

and Saturday - 0800-1200 hrs. 
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As each trainee executed a particular lesson, he recorded 
certain categories of information and comments on the forms 
provided. Upon completion of a specific lesson, the trainee 
completed the lesson attitude form. These forms along with 
a hard copy of the lesson as output at the remote terminal as 
well as trainee records processed off-line at the completion 
of each computer session were collected by the contractor. 
In addition, each monitor recorded certain categories of data 
and made comments concerning system operation and efficiency, 
hardware experiences and trainee problems or comments. All 
of these data were used by the contractor to perform a detailed 
frame analysis of the lesson material..* Based upon this 
analysis, appropriate modifications were made to the lesson 
material. No formal critique sessions were conducted during 

this validation phase although informal critiques did occur 
between the trainees and monitors. 

2. Test Results 

Emphasis during Phase I was primarily focused upon: 

o Modifying the material to eliminate inconsistencies, remove 
difficult and/or ambiguous areas of instructional material 
and to incorporate pertinent suggestions/comments received 
from the trainees and monitors. 

o Determining the average length of time for trainees to execute 
each lesson. System down time caused by hardware, program 
errors, and lost time due to illegal/illogical course execution 
was to be factored out from on-line course execution time. 

During Phase II primary emphasis was focused upon the teachability 
of the lesson material as measured by the success or failure to 
pass the criterion items associated with each lesson. 

Analysis of the data gathered indicated that the Phase I trainees 
required an average of 45 hours to execute all the lessons. When 
breaks and remote terminal down time is included, the average 
time to execute the course increases to approximately 60 hours. 
The range including these latter factors (breaks and remote terminal 
downtime) was 50 to 70 plus hours.** 

Because of the rotation of the trainees among the remote terminals 
in the Phase II, complete data concerning the length of time to 
execute individual lessons in a simulated classroon environment 
was not collected. However, it is felt that the above times are 
meaningful in that as far as possible all time parameters not 
related to actual on-line execution were factored out. 



* See Appendix III, Xable 11 for an example of this frame analysis process. 
** See Appendix III for the detailed analysis of data collected from Phase I and II- 
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The allocation of time expended can be compared between Phase I and 
Phase II. As Table 1 indicates, the effective time (i.e., actual 
on-line execution) for Phase I was 56. 4%. This is contrasted with 
a 69.9% effective time during the Phase II validation activity. 
There are several reasons for this 13.3 increase. During Phase I, 
all components of the validation activity were being "shaken down" 
for the first time in a heavy workload environment. This included 
the B 3500 system software and hardware, the CDTS (formal qualifica- 
tion testing had not yet been performed), and the course material. 
The operational efficiency and reliability of all of these com- 
ponents had increased by the time Phase II was conducted. This 
is evident when time lost due to various software /hardware mal- 
functions between Phase I (14.0%) and Phase II (9.7%) are com- 
pared. Also, during Phase I the CDTS required several recompila- 
tions (8.6% of the allocated on-line time) to correct known 
errors or improve operating efficiency. This activity was not 
required during the Phase II validation activity. 

A factor which tends to distort the computation of the effective 
time was the inability to "start" the computer training sessions 
as scheduled. This was normally due to the overlapping of 
computer operations from the previous shift into the time 
allocated for the computer training sessions . The "time lost" 
was treated as any other factor which reduced the trainee's 
scheduled time for lesson execution. If this factor is removed 
from the analysis, the effective time would be 66.3%> and 78.9%, 
for Phase I and II respectively. 



TABLE 1 Time Allocation- -Phase I and II Validation Activity 



Phases 
I II 

1. Effective time 56.4% 69.9% 

2. Non effective time 43.6% 30.1% 



Malfunctions (OS, DISK, DCH, etc.) 14.0% 9.7% 

Computer Operations 

End of day processing, 
Driver routine 

Remote Terminal Downtime 

CDTS Recompilations 

Misc (lesson logic, wasted review) 

43.6% 30.1% 
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The only increase in noneffective time between Phase I and 
Phase II was remote terminal downtime. In Phase I only six 
(6) remote terminals were required at any given time. This 
permitted a backup remote terminal to be available for use in 
the event a remote terminal malfunctioned. When this occurred, 
the trainee was moved to a backup remote terminal negating 
excessive loss of on-line time. This was not possible during 
Phase II as all remote terminals were required. 

When a remote terminal malfunctioned, it resulted in a direct 
loss of effective time as the trainee or trainees scheduled 
for that particular remote terminal had no backup. The time 
lost had to be made up at the next scheduled time on a func- 
tioning remote terminal. If a remote terminal was nonoperational 
for the entire computer session, each trainee lost one (1) hour 
of on-line execution time. 

Another area of investigation during the validation activity 
was response time latency. (See Figure 5) This was defined 
as the interval of time after a keyed response and the carriage 
had been returned to the leftmost position, until the next 
message was received at the remote terminal. 
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Prior to the validation activity, no data were available as 
to the effect an increase in system users and/or programs would 
have on the processing of trainee inserted answers. Also the 
CDTS was specifically not designed to operate in a dedicated 
environment and in an operational setting most probably would 
not. The effect of other programs operating within the B 3500 
system on the processing time of the CDTS needed to be determined. 

During Phase II, the monitors were instructed to record response 
latencies every 30 minutes.* Also, since the CDTS was for the 
most part operating as the only program within the B 3500 system 
during the validation activity, on several occasions, one or 
more programs were caused to operate at the same time the CDTS 
was in operation. 

The data collected indicated that the median response time 
regardless of the number of users or programs operating in a 
multiprocessing prioritized environment was 7 seconds.** 

As expected, when the CDTS was operating within the B 3500 
system with other programs the response latency did tend to 
increase to approximately 10 to 12 seconds. It also appeared 
that as the number of users increased the response latency 
increased 1 or 2 additional seconds. The damping factors to 
consider if stringent conclusions are attempted is the operation 
of the remote terminals themselves and the accuracy of the 
monitors in their recording efforts. At best, it appears that 
increases in system users causes less increase in response 
latency than operating additional programs within the B 3500 
system. The response latencies experienced by most of the 
trainees seemed to be well within tolerable limits. 

The overall performance of the Phase II trainees on the criterion 
test items was 83/85. Individual results on the lessons is con- 
tained in Appendix III Table 9* No data are included within this 
report from the Phase I trainees. Based upon their performance 
and comments, various test items as well as lesson material 
was modified. Comparing their overall performance with the 
Phase II trainees is not considered meaningful. 

The criterion test items which had a frequency of three or more 
errors in Phase II were subjected to a detailed analysis. A 
sample of this item analysis and disposition is indicated in 

Appendix III Table 11. 



* See Appendix III Table 12 for response latencies recorded by monitor during Phase II. 

** The maximum number of system users was eight and the number of additional programs 
was three. & K 6 
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Attitudes 



Toward the Lessons 

The trainees for Phase I and II were required to fill out a 
ten item attitude form after completing each lesson. The 
results are indicated in Table 2 for Phase I and Table 3 for 
Phase II. A different weighting system was used for each 
Phase. The data from Phase I indicates a definite bi-modal 
distribution of lessons with lessons 2, 7, 8, 5 and 12 having 
a less favorable effect upon the Phase I trainees. After 
modification of the lesson material, the distribution of 
attitude toward the lessons by the Phase II trainees approx- 
imates a normal distribution. 



Examination of the two tables indicates that lesson 9 was con- 
sidered the most "popular" for both groups of trainees. Except 
for lesson 2, the lessons scoring lowest in Phase I basically 
retained their relative standing even though the overall 
attitude toward the lessons in Phase II was less divergent. 



TABLE 2 Phase I Trainee Attitude Toward Lessons. 
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The question of whether attitude toward the lessons was 
affected by the performance was also considered. A scatter 
gram was prepared using data from Phase II (Figure 6) in 
which the median criterion test scores were plotted against 
the median scores reflecting the trainee ! s attitude toward 
each lesson. Inspection of the scatter gram does not yield 
conclusive evidence to indicate that the higher the perfor- 
mance as measured by the criterion test scores the more 
favorably perceived was the lesson. Lesson 8 however reflects the 
lowest performance score and the attitude toward this lesson 
was also the lowest. 

Lesson 9 was considered the most favorable even though the 
performance on this lesson was not the highest. Of the re- 
maining lessons, approximately 6 tended toward the direction 
of high performance — favorable attitude, whereas 6 other 
lessons tended slightly toward the direction of not quite as 
high a performance—less favorable attitude. 

The complexity of the material was not specifically factored 
out in the analysis. However, the lessons in which performance 
was lower tended to be the more complex lessons within the 
course. 



TABLE 3 Phase II Trainee Attitude Towards Lessons, 
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Toward the physical facility* 

At the completion of the validation activity the trainees were 
asked to consider the physical environment in which the computer 
assisted instruction was administrated. All of the trainees 
indicated that their general comfort was satisfactory and the 
lighting/ventilation was more than acceptable. 

Toward the remote terminal 

In general the attitude of the trainees toward the remote terminal 
was favorable. The trainees indicated that the operation was 
very easy, the material as output very easy to read and the rate 
of presentation for 757o of the trainees was about right. For the 
remaining 25% of the trainees it was felt to be too slow for their 
reading ability. Only one trainee felt that his typing skill was 
not adequate for the required tasks. All trainees except one 
indicated that the remote terminal was adequate for presentation 
of the lesson material. Sample comments from the trainees in- 
dicated that: 

o Presentation too slow because of time outs and system 
failures . 

o The noise level distracting and uncomforting. 

o Reaction time was extremely slow. 

o Main problem is response time - typing speed is too slow - 
need CRT. 

o Terminal is adequate if the response is up to par and the 
system is in working order. 

o Material typed out varied from good to bad, depending on 
the condition of ribbon, paper, etc. 

Toward CAI 

Trainee attitude in this area was of special interest. For the 
majority of the trainees this was their first exposure to com- 
puters and for all trainees their first exposure to computerized 
instruction. 

Even discarding a novelty effect which was probably aided by 
some level of Hawthorne effect as the trainees knew they had 
been selected to participate in this Air Force funded project, 
the reaction to CAI by the trainees was most favorable. Eighty- 
three percent indicated that CAI seemed to make the material 



Only attitudinal data collected from the Phase II trainees are presented unless 
noted otherwise. It was felt that the interaction required during Phase I 
between the validators/monitors and the trainees might have biased the data. 
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easier to learn and tended to increase their level of interest 
toward learning the material. Only one trainee felt the course 
was too long whereas all trainees indicated that interacting 
with a computer was most interesting. There was mixed feelings 
about the length of time at the remote terminal for a given 
computer session. Sixty^six percent felt the time was about 
right, with the remaining trainees split in their feelings 
between the sessions being too long or not long enough. The 
trainees did not feel that CAI should replace other more con- 
ventional types of instruction. Over 807 o indicated that CAI 
should be used in a complementary role as opposed to a re- 
placement vehicle. This was further substantiated by all of 
the trainees indicating that at some point in executing the 
lesson material they felt a need for non-computerized assistance. 
Representative comments from the trainees indicated: 

o PI could be learned in the same way. 

o Do not recommend CAI for replacement of other types of 

instruction, but should be used for presenting the majority 
of subject areas. 

o Repetition, although necessary, was the worst part. 

o Need more humor. 

o To teach this way is too expensive. 

o Of great advantage over the traditional student/lecturer 
system. 

o I could have concentrated more easily in the daytime. 

o I enjoyed the course and believe I learned a lot. 

B. Formal Qualification Testing of the CDTS 

Formal Qualification Testing (FQT) was conducted as part of the 
Category I Test Phase in accordance with section 4 of ESD-TR-68-301 
and TM-(L) -3724/003/02 to verify that the CDTS operation conformed to 
the requirements as stated in the Part I CEI Specifications. 

1. Test Concept 

The basic test concept as specified in the Test Plan was followed. 
The production of expected outputs as a result of internal reaction 
to a set of inputs provided the basis for the verification of proper 
subsystem operation. In addition, specific inputs were made via the 
the test vehicles to exercise each subsystem function in a system 
context and a system output used to verify that the function operated 
properly. Exercising of each separate system function was accomplished 
during the preliminary qualification testing in conjunction with the 
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validation of the Computer Operator's Course. To accomplish this, 
the three basic tests as indicated in the Test Plan were developed. 
(DEMO01, DEMO02 and OFLINE) . 

2. Test Objectives 

The basic objectives of each test was to verify the performance of 
a functional area or segment therein. It was not always possible 
to completely isolate a given functional area or segment, as the 
test input could cause the generation of an output which required 
the interaction of more than the specific area under test. 

Also, as it was not possible to test every conceivable combination 
of inputs and conditions, the test was concerned with those com- 
binations which were predicated as the most likely to occur. 

3. Location and Schedule 

The test was conducted at the Sheppard Technical Training Center in 
accordance with the schedule, as set forth in the Test Plan. The 
actual test required only 16-18 June 1969 to be accomplished. 

4. Personnel Requirements 

The Air Force Test Team was officially composed of military and 
civilian personnel from the following agencies: 



Agency 
Hq USAF (AFADAB) 
Hq USAF (AFADAE) 
Hq USAF (AFPTRD) 
Hq USAF (AFPMDC) 
AFDSDC (DI) 
ESD (ESLFE) 
Hq ATC 
STTC 
KTTC 
Contractor 



Representatives 



2 
2 
1 

3 



Apart from the official Test Team, visitors from these as well as 
other agencies attended the FQT sessions. 



33 



Test Structure 

The three basic tests--DEMO01, DEMO02 and OFLINE were developed 
by the contractor in advance of the test activity with the actual 
generation being accomplished at the STTC using the Phase II Base 
Level System. 

The decision to construct lesson-like" tests was based upon the 
varying backgrounds and knowledge of the CDTS by members of the 
Test Team. Knowledge ranged from considerable details of the CDTS 
operation gained from experience as monitors during the validation 
of the Computer Operator's Course to a general appreciation of the 
project and CDTS operation. 

Rather than attempt to bring all Test Team members up to some level 
of expertise concerning the CDTS operation prior to the FQT, it was 
reasoned that the system in many instances could "demonstrate and 
test" itself. The tests, therefore, were designed to accomplish 
two basic tasks. 

o Impart general as well as specific information about the CDTS, 
including its capabilities , basic operating instructions , re- 
strictions and limitations. 

o Fully exercise and demonstrate the on-line Execution, Building 
and Editing Functions (DEMO01 and DEMO02) and the off-line 
Lesson Building Function (OFLINE). 

The general functions contained within each test which were to be 
demonstrated and verified were: 

TEST FUNCTION 

DEMO01 Brief Description of CDTS 

GET Command 
CO Command 
CDTS Options 

GOTO 

QUIT 
Lesson Building 

Group 1 

Group 2 

Group 3 

Group 4 
Lesson Editing 

Insert 

Delete 

Print 
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DEMO02 SAVE Command 

STATUS Command 

RESTART Command 

EX Command 

Lesson Execution 
Group 1 

Group 2 Q and M 
Group 2 D 
Group 3 Q and M 
Group 4 Q and M 

Keyword , Phone tic, Orde r 
Trainee Record Processing 

OFLINE Categories of legal and illegal 

inputs . 

Test Materials 

Each member of the test team was provided the following materials: 

o Test Plan 

o Users Manual 

o Copios of the test scenarios. 

o Listing of the tests--DEMO#l and DEMO02. 

The tests, DEMO01 and DEMO02 were generated from card decks using 
the CDTS Off-line Lesson Building Function, stored on disk and 
available for use when requested. 

Test Conduct 

a. General 

Two members of the Test Team were selected to serve as a 
"trainee 11 and as a "course designer 11 respectively. These 
two Test Team members conducted the portion of the test which 
required the use of scenarios in conjunction with the in- 
structions contained within the test vehicles. Two remote 
terminals which were adjacent were selected for this activity 
to facilitate the inter action required during the FQT between 
the "trainee 11 and the "course designer." 

Contractor personnel worked closely with these two Test Team 
members and this specific activity x^as considered to be the 
"official" test. The remaining Test Team members conducted 
the test as instructed within DEMO01 and DEMO02 as "trainees" 
bypassing those sections of the test requiring actions by a 
course designer. Many Test Team members did interact with the 
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CDTS as course designers but did not follow a prescribed 
scenario. This activity was considered to be part of the 
FQT but in addition to the "official 11 Test Plan activity. 

Prior to the start of each test session, the computer operator 
initiated the Data Communications Handler, identified NEET00, 
the remote terminals to be accessable and entered the appropriate 
SPO commands to indicate that NEET00 was to be started. 

b. Specific 

1) Day 1 

At the start of the first session, DEMO01 was requested by 
the "trainee" and the FQT officially commenced. The "trainee 1 
followed the instructions contained within the test vehicle 
itself. At appropriate points the "course designer" was 
instructed to follow a specific scenario or initiate an 
action(s) at his remote terminal. 

The "trainee" and "course designer" used the listings of 
test vehicle to follow as well as verify that the test was 
proceeding as planned and the CDTS was functioning as 
specified. 

Functions demonstrated and verified included: 

o GET Command 

o CO Command 

o CDTS Option - GOTO 

Trainee records for all participating Test Team members 
were generated at the completion of the test session. 

2) Day 2 

DEMO01 was again requested by the "trainee" and the FQT 
continued. 

Functions demonstrated and verified included: 

o CDTS Option - Quit 

o Lesson Building 

o Lesson Editing - Computer Operator's Course Lesson 6 
was the test vehicle. 

Trainee records for all participating Test Team members 
were generated at the completion of the test session. 
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3) Day 3 

DEMO02 was requested by the "trainee 11 and the FQT con- 
tinued. 

Functions demonstrated and verified included; 

o SAVE Command 

o STATUS Command 

o RESTART Command 

o EX Command 

o Lesson Execution 

o Service Functions 

At the completion of DEMO02, the on-line FQT was completed. 
The FQT of the off-line Lesson Building Function was dem- 
onstrated and verified by the test--OFLINE. 

The CDTS generated OFLINE from a card deck indicating the 
various errors and discrepancies as contained therein. 
The card deck was corrected by a Test Team member following 
the scenario provided and OFLINE regenerated as an "error 
free 11 lesson. 

Trainee records for all participating Test Team members 
were generated at the completion of the test session. 

8. Test Results 

The off-line listing of the tests--DEMO01 and DEMO02 were used 
during the conduct of the FQT to ensure that the tests functioned 
as designed. One discrepancy, the incorrect printing of an item 
value, was detected and corrected prior to the end of the FQT. 

The CDTS also allowed a non-course designer to obtain a lesson 

using the command, #get L , which permitted undesirable access 

to a lesson. The use of this form of the "get 11 command has since 
been restricted to use by course designers and appropriate doc- 
umentation issued. 

Finally, the implementation of the initial lesson library func- 
tion as designed by the contractor was not acceptable to the 
Air Force. During the FQT, and acceptable programming solution 
and attendant capability was developed. The general 
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concept of the selective lesson loading from tape to disk 
is that all lessons to be accessed during a given on-line 
period of operation will be identified prior to the commence- 
ment of that period. The off-line lesson building program 
was modified to permit the addition or reconstruction of 
the lesson file table of contents, based upon a control 
card input. This permits a new lesson to be added to an 
existing file or for the old contents to be completely 
replaced on a day-to-day or run-by-run basis. It is 
not possible however, to load additional lessons from 
tape to disk during an on-line session. If it should become 
critical to obtain access to additional lessons from tape 
during an on-line session, the CDTS can be closed down and 
additional lessons loaded from tape to disk in a relatively 
short period of time. 

The on-line printouts of "trainee 11 and "course designer 11 
actions as a result of executing the tests and inputting 
data in accordance with the scenarios are contained with- 
in Appendix IV. 

In addition, the off-line printout of the test--OFLINE, 
depicting the errors and the on-line execution of the 
test after the errors were corrected are contained within 
Appendix IV. 

Selected trainee records were compared against the on-line 
printout and the off-line listing of the test to verify 
the accuracy of the record content. No apparent discrep- 
ancies were found. A sample trainee record is also con- 
tained in Appendix IV. 
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Section IV 



CONCLUSIONS AND RECOMMENDATIONS 



This project provided members of the staff with valuable experience in 
several general areas : 

o The design and implementation of a modularized computer assisted 
instructional system. 

o The development, construction and validation of an extensive computer 
assisted training course with primary emphasis upon performance 
oriented tasks. 

o The extension of knowledge in the use and operation of third generation 
computers . 

This experience is translated in this section into conclusions and re- 
commendations for improvement to the current CDTS, additional capabilities 
and finally considerations for use of the CDTS as a research vehicle. 

A. Improvements to the current CDTS 

During the Formal Qualification Testing several suggestions for mod- 
ifying and/or increasing the capability of the CDTS were expressed 
by members of the Air Force Test Team as well as project personnel. 
A summation of these comments follows. No attempt has been made to 
estimate the costs (manpower as well as additional system capacity 
requirements) to implement any or all of these suggestions. 

o Increase the 400 character frame limit. 

Currently the course designer is somewhat confined by being limited 
to the use of only 400 characters per frame. Although frames can 
be "split", this in turn reduces the potential number of frames 
available for a given lesson. Each "split" frame requires a dif- 
ferent frame number which subtracts from the 300 frame per lesson 
limit. In addition, the internal splitting of the answer and 
action groups is illegal. These groups must be complete within 
the specific frame in which constructed. This may severely limit 
the number of answer- choices either presented to the trainee for 
selection or provided for matching purposes as well as actions 
programmed as a result of the response entered by the trainee. 

o Redesign the Phonetic encoding process. 

The current Phonetic encoding process does not automatically allow 
for pluralization of responses. In many instances, a word plural- 
ized is not equivalent phonetically to the singular version of the 
word. This requires that the course designer allow for variations 
of correct responses including in many instances — plurals . Also, 
the encoding processing should be examined to determine if a more 
efficient method could be developed to increase the sensitivity 
and thereby reduce the number of inappropriate phonetic equivalents 
which are now possible. 
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o Remove inactive users from the system. 

It is currently possible to remove all or selectively remove users 
from the system regardless of their status—active or inactive. 
However, the procedure to selectively remove users is considerably 
more complex. As the use of the CDTS increases, it can be predi- 
cated that the number of users (course designers /trainees/system 
demonstrators, etc.) will also increase and the User Control Table 
(UCT) may on occasion approach capacity. A more user oriented 
procedure to remove users from this table who are in an inactive 
status needs to be developed. 

o Record clock time on individual history printout. 

It is not currently possible to automatically measure the amount 
of time a trainee takes to enter a response to a specific question 
within a lesson nor accumulate the total time necessary to nego- 
tiate a specific lesson. Collection of these data must be accom- 
plished manually requiring manpower and time expenditures beyond 
the usual available resources. Having the CDTS include a time 
parameter as a data item within the performance records currently 
maintained would make this information readily available to appro- 
priate Air Force personnel responsible for the validation of lesson 
material. 

o Increase the number of frame labels. 

Currently, the CDTS permits the labelling of 50 frames. The ability 
to branch to a labelled frame using the GOTO option was especially 
useful during validation to recover or circumvent lesson errors, 
machine and/or program failures which disrupted the training ses- 
sion. Still, in many instances, lesson material had to be repeated 
unnecessarily as the number of labelled frames was severely limited. 
The number of labels permitted should be increased or the ability 
to GOTO a frame number be added to permit more discrete recovery 
from lesson disruptions. 

o Record exact trainee responses. 

Currently the CDTS records only the letter which was selected 
for input by the trainee in response to a multiple-choice question 
or the letter which matched the inserted response in the question 
frame. As a diagnostic tool, the recording of the exact response 
input by the trainee would aid immeasurably the task of course 
designers in analyzing existing lesson material for further mod- 
ification and/or additional material. The impact on the immediate 
storage requirements and response processing would have to be 
assessed. 
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o Additional prompting. 

In this initial design of the CDTS there is a minimum of informa- 
tion generated to assist the user during the building of a lesson. 
When a message or cue is output there is no additional information 
provided if the user doesn't fully comprehend. It was suggested 
that the current set of messages be linked to an additional level 
of expository messages which would be output when requested by the 
course designer. This could be made to provide the bare rudiments 
of a tutorial dialogue. 

B. Additional Capabilities 

During the design of the CDTS certain functions were restricted or 
excluded to enable the system to be designed, developed, tested and 
ready for release in a timely manner. However, it is felt that certain 
of these capabilities would be most advantageous and should be given 
further consideration to increase the efficiency and application of 
the CDTS.* 

o On-line assistance to the Trainee. 

Unless provided by the course designer within the context of the 
lesson material, the trainee cannot receive additional assistance 
during lesson execution. One method to provide assistance to the 
trainee is to build it into the lesson. An attempt to provide 
assistance to the trainee in this manner is extremely difficult 
to construct, anticipate where or when the assistance will be 
required and tailor the information to the individual trainee 
needs. However, it is felt that certain guidelines could be 
determined and programmed into the CDTS. If it were determined 
that certain information would be variable, provision could be 
made to allow the course designer to insert the necessary infor- 
mation. 

o Lesson Presentation Media. 

Currently the CDTS is designed to interface only with the Frieden 
Remote Terminal. This is restrictive in the rate in which infor- 
mation can be presented as well as the type of information. A key- 
board/printer severely limits the presentation of graphic displays. 
The CDTS should be modified to enable interfacing with appropriate' 
cathode ray tube equipment to permit the timely presentation of 



* Certain capabilities were discussed at conferences /meetings conducted during 
the tenure of this project. 
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textual as well as graphic material. In addition, the keying of 
responses should be supplimented by providing the user the ability 
to input information via a light pen device. Coupled with these 
capabilities could be provided the ability to control though the 
lesson frames audio visual devices, tape recorders, etc. In effect, 
the CDTS should be modified to permit the interface and control of 
various multi-media devices to increase the course designers sphere 
of lesson construction capability with the attended benefits trans- 
ferring to the trainee in the manner of presentation and response. 

o Calculation capability. 

A computational capability was excluded from the initial design of 
the CDTS. No mathematical capability is available for use by the 
course designer as a separate tool outside of lesson construction 
or within the context of the lesson. Similarly, the trainee must 
insert an exact numeric response to receive proper credit. The 
CDTS is incapable of determining whether programmed answers/inserted 
responses are algebraically equivalent.* 

At a minimum, the ability of the CDTS to perform calculated numeric 
matching during the execution of a lesson should be available. This 
would reduce the necessity of the course designer to provide various 
combinations and permutations of numeric answers in anticipation of 
what a trainee might insert. The course designer could then rely 
upon a ,f built-in fl answer/response numeric comparison processor. 

Depending upon the capability provided, the course designer as well 
as the trainee should be able to define and manipulate functions 
and matrices and call upon various computational service routines. 
While receiving on-line instruction, the trainee should be able to 
construct mathematical functions for his own individual use as 
needed for problem-solving. A trainee could label the functions he 
creates and use them whenever he needed them--in effect, he could 
create his own library of computational aids for problem solving. 

The course designer could couple the computational capability with 
the decision language already existing within the CDTS to more 
finely control the trainee* s path or sequence through the lesson. 
For example, in addition to trainee performance data automatically 
stored by the CDTS, the course designer might wish to keep track 
of the trainee's current position in the lesson or whether in a 
review status for subsequent use in a conditional decision state- 
ment . 



* During the Phase I and II validation activity, an exhibit handbook (TM-(L)-3725/ 
012/02) was used to present tabular and graphic presentations in lieu of a 
cathode ray tube. 
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o Lesson Construction Quality Control. 

The CDTS provides a minimum of quality control during the con- 
struction of lesson material by a course designer either on-line 
or off-line. Apart from determining whether legal labels have 
been inserted or decision statements have been properly stated, 
the responsibility of properly constructed lessons falls upon the 
course designer. This requires that the course designer execute 
(on-line) the lesson as a "trainee" attempting to check out various 
sequences to ensure that the material is logically constructed. 
This takes course designer time as well as on-line computer time. 

An additional capability should be added to the CDTS to automatically 
quality control lesson material for logical construction. This could 
be accomplished off-line. For example: the lesson material could 
be checked to determine that all branches are legal, frames contain 
the required groups and are in the proper sequence when split and 
correct responses have been included when required. Having determined 
that the lesson was constructed "logically", the course designer 
could devote his time and the computer's to determine if the material 
is meaningful to the target population. 

o Response Latency Control. 

There is no method available to control the length of time in which 
to anticipate an inserted response by a trainee before a programmed 
intervention can be executed. 

A trainee could "sit" an excessive length of time without receiving 
any prompts or aids to assist him in proceedings with the lesson 
material. To circumvent this deficiency the CDTS could be modified 
to provide a tolerance parameter in which to anticipate a response. 
If the trainee did not respond within a specified time period, the 
program would initiate the action provided by the course designer. 

In addition to these specific capabilities which were restricted or 
avoided in the initial design of the CDTS, it became apparant during 
the life of this project that other capabilities/recommendations should 
be considered for the future versions of the CDTS. Two of the more 
important as well as feasible additions are: 

o A CDTS internally controlled review. 

Although a trainee can GOTO a frame labelled REVIEW, this is a 
limited capability. A function built into the CDTS could permit 
the trainee to request REVIEW at any time and the program would 
print out the topics /sections available for selection. (Topics/ 
sections would be specified by the course designer during lesson 
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construction.) The trainee could review any time after completing 
the first topic. The program would prevent a trainee from review- 
ing a topic until completion of that topic had occurred. At the 
end of each topic reviewed, the program could query the trainee as 
to whether he wished to review additional material or return to 
the appropriate point within the lesson. 

o Group Summary of Trainee Records. 

The automatic capability to summarize more than one individual 
trainee's record of performance is nonexistent. To obtain an 
estimate of several trainee's performance who are taking the 
same lesson material requires manual data manipulation. A 
capability to provide summation data for one or more trainees 
should be provided to enable Training Supervisors to better 
assess trainee progress and performance across various courses 
of instruction. 

C. Further Implications 

The CDTS was pointedly designed to provide the Air Force a computer- 
ized vehicle to meet many of the varying on-the-job requirements with- 
in an operational environment. And, as part of this project an initial 
step (the computer operator 1 s course) was instituted toward meeting 
one of these requirements.* In addition to this specific course, the 
capability now exists to develop and implement additional courses in 
such varied areas as finance, transportation, inventory control, pro- 
gramming, etc. These courses could be standarized or tailored to fit 
individual requirements at specific installations. Also, each in- 
stallation which had the CDTS could develop specialized material to 
meet additional training or operational requirements. 

Developing a programming course could not be adequately accomplished 
using the current CDTS. The theory, rules, regulations and conventions 
of the programming language under consideration could be taught using 
a CAI approach. However, to provide the trainee with the ability to 
develop his own programming routines, check them out and provide error 
messages and remedial material, would require several changes to the 
CDTS. The CDTS would have to be able to simulate the syntax processing 
of the specific compiler or be able to gain access to an actual compiler. 
This would permit the trainee to develop his programming routines and 
have them operated upon in a realistic manner. 

Finally, as an aid in the implementation of the CDTS, lesson material 
could be developed in the CDTS language that would teach potential 
users how to use the system. Not only the language structure, con- 
ventions and restrictions, but n how" certain capabilities can be used 
and "why 11 . This material would supplement the user's manual. 



* The Base Level System is primarily for management use. The CDTS was designed 
to train users of the Base Level System. 
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Apart from the practical application of the CDTS, it should be con- 
sidered for use as a research tool. The use of CAI techniques as 
they pertain to performance related tasks needs further investigation. 
At various points in the Computer Operator's Course the trainee was 
instructed to leave his training device and perform "hands on" train- 
ing to complement the tutorial material. This blend of tutorial 
material with "hands on" training is at best difficult to achieve in 
an effective manner. 

The CDTS could be used to develop material which could be directed 
toward areas such as: 

o When and how could tutorial and "hands on" training be complemented? 
o Where or how can CAI be applied in team related tasks? 

o Cost factors involved in the incorporation of audio/visual devices. 
Is the increase in learning (if any) worth the cost? 

o What is the application for CAI at the command and control level? 

to indicate a few. 

In conclusion, it is recommended that the improvements to the current 
system as well as the additional capabilities be given strong considera- 
tion for implementation. This would greatly aid the production and 
presentation of training material, facilitate the operation of the 
system, and permit increased data analysis of individual/group perform- 
ance. Finally, the use of the CDTS as a research tool should be 
exploited. 
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Section V 
PROJECT PERSONNEL 



Dr. John W. Cullen, Project Head, Advanced Projects, was principal investigator 
for this project and supervised the full time effort of these project members 
for the entire term of the project. 

Mr. Alfred K. Butler, Human Factors Scientist, responsible for the 
Operational Specifications, Users Manual for the CDTS and field 
validation of the Computer Operator's Course. 

Mr. Richard S. Cowdery, Computer System Specialist, responsible for 
coordinating the overall programming effort for the design, develop- 
ment, assembly, and test of the CDTS. 

Mr. Larry R. Harris, Human Factors Analyst, Senior, responsible for 
the coordination and development of the Computer Operator's Course 
Material. 



During this project, personnel were brought on board for varying 
levels of effort to assist in the development of the CDTS and the 
Computer Operator's Course. 

Name Title 

Peshek, L. D. Programming Analyst Senior 

La Point, J. E. Computer Programmer Analyst, Senior 

McBane, D. K. Programming Analyst Senior 

Pratt, E. M. Programming Analyst Senior 

Hourigan, J. P. Human Factors Scientist 

Dagley, H. C. Human Factors Analyst, Senior 

Maginnes, E. B. Human Factors Analyst, Senior 

Two student associates, Mr. Edward Brill, Stanford University and 
Mr. John Keats, Florida State University, worked full time on the 
project during the summer of 1967 and 1968 respectively in residence 
in Santa Monica. Mr. Keats developed the initial material for 
Lesson 2 - Number Systems for the Computer Operator f s Course and 
Mr. Keats transcribed Lessons 1-8 of the Computer Operator's Course 
from the operational specifications into PLANIT lessons ready for 
conversions into the CDTS format. 
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Section VI 

PROJECT DOCUMENTATION 

ESD TR-68-152 

Operational Specification for a Computer-Directed Training Subsystem for Inte- 
gration into the Air Force Phase II Base Level System, li March 1968. 

ESD-TR-68-301 

Performance /Design Requirements and Detailed Technical Description for a 
Computer-Directed Training Subsystem for integration into the Air Force Phase 
II Base Level System, June 1968. 

TM-(L)-3724/002/00 

Test Plan for the Validation of the Computer Operator's Course Module, 15 
December 1968. 

TM-(L)-3724/003/02 

Category I Test Plan Computer-Directed Training Subsystem for Air Force Phase 
II Base Level System, 1 August 1969. 

TM-(L)-3724/004/01 

Users Manual Computer-Directed Training Subsystem for Air Force Phase II 
Base Level System, 30 October 1969. 

TM-(L)-3724/005/00 Draft 

Formal Qualification Test Results Computer-Directed Training Subsystem 
for Air Force Phase II Base Level System, 1 August 1969. (The substance 
of this document has been included within this document as Part III, 
Testing and Evaluation and Appendix D) 

TM-(L)-3724/006/00 DRAFT 

Detail Specification Part II Computer-Directed Training Subsystem for 
Air Force Phase II Base Level System, 12 November 1969. 

TM-(L)-3725 Volume 001 through 018 

Computer Operator Material for a Computer-Directed Training Subsystem for 
Integration into the Air Force Phase II Base Level System, 15 March 1968. 
(Final lesson documentation will be released as off-line listings. The 
outline and course objectives are presented in Appendix B) . 

The validated Computer Operator Course Exhibits TM-(L) -3725/012/02 dated 
1 July 1969 will be released with the off-line lesson listings. 

In addition to these documents, monthly reports for Contract F19628-68-C-0399 
P001 were issued as TM-4027, Volume 000 through 015 and quarterly reports 
for contract F19628-67-C-0427 P002 were issued as TM-4142, Volume 000 
through 005. 
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Appendix I 



FLOW DIAGRAM OF THE CDTS 



This Appendix presents the system flow for the Computer-Directed Training 
Subsystem, 
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SYSTEM FLOW 



The Computer -Directed Training 
Subsystem permit* the present- 
ation of lesson material to 
trainees through the Lesson 
Execution Mode. Material is 
presented on line in an inter- 
active environment. Inserted 
answers are processed by the 
program and compared vith 
the answers specified with- 
in the lesson for a pos- 
sible match. 

Based upon the answer- 
matching process, the pro- 
gram executes the appropri- 
ate action. The answer- 
matching tolerance may be 
increased through the use 
of PHONETIC encoding, 
KEYWORD matching and ORDER 
sequencing. 

The trainee may review 
selected parts of the lesson, 
discontinue a particular 
session and return to the 
proper point in the lesson 
at a subsequent session. 
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This mode permits on line 
construction of course mat- 
erial. After initial pro- 
gram load the user may in- 
sert the comaand to commence 
building a lesson. 

Lesson material is inserted 
within a series of units 
termed "frames". 

The program presents the frame 
types for selection. The 
program branches from group 
to group within the frame 
type selected permitting the 
insertion of textual mater- 
ial, answers and subsequent 
actions. Decision 
statements can be for- 
mulated and entered into 
the lesson. 



As each frame is construct- 
ed the program stores the 
content in the lesson table, 
branches to the Frame 
Selection Function and 
the process may he 
repeated. The course 
designer may preserve 
course material onto 
an appropriate peripheral 
component with a name and 
ID associated with it. 



LE8S0K B'JIIDIMC MODE 



TABLE 

INITIALIZED 





existing LE880S 
LOADED FROM 
SYSTEM AUXILIARY 
STORAGE FOR 
MODIFICATION OR 
AEtUTinJAL FRAMES 



COURSE DESIGNER 
INSERTS LeSSOtl THCI, 
ANSWERS, ACTIONS, FEED- 
BACK WITH ANY COMBINATION 
OF FRAME TYPES DESIRED 



( START J 



L55N 19 

SAVED ONTO 

STORAGE 

1EVICE 



yf ROCKSS ON / 
flHMEDIATs L 
\ACCtSS \ 

\STORAQE \ 
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DESIGNER) SPECIFIES THE 
PROCESSING OF INDIVIDUAL 
RECORDS AND CAN 
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HISTORIES AND/OR SUMMARIES 
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The program stores hist- 
orical records of the trainee's 

path and answers through the lesson in a Trainee Record Table. 
This table may be processed for off-line individual Sunmary 
as well as History d«ta. 
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Appendix II 



COMPUTER OPERATOR'S COURSE OUTLINE, OBJECTIVES 
AND SAMPLE OF COURSE MATERIAL 

This Appendix presents the Computer Operator's Course Outline and Objectives, 
In addition, an example of lesson material from both the course design and 
t ra inee s tandpoint is inc luded . 



Page 

Course Outline 52 

Course Objectives 72 

Example of Lesson Material from the Course Design/Trainee Viewpoint . . 112 
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COURSE OUTLINE 
ORIENTATION AND INTRODUCTION TO COMPUTER CONCEPTS 
A. Introduction to Computer Concepts 

1. Dispelling computer myths 

a. They don't think 

b. They are controllable instruments of man 

2. Explicitness of man-machine communication 

3. Definitions 

a. Lack of universal definitions 

b. Data base 

c. Calculator vs. computer 

d. Program — computer operator 

e. Hardware— software 

f. DP--EDPM--EAM--PCAM--EDP/ADP 

4. Historical sketch 

a. Babbage-- father of computers 

b. Hollerith—punched cards 

c. World War II--advent of electronics 

d. UNIVAC— commercial availability 

5. Generations 

a. First — tubes 

b. Second— transistors (solid state) 
c Third- -microminiaturization 
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B. Characteristics /Configurations 

1. Digital/analog-hybrid 

2. General purpose vs. special purpose 

3. Solid state- -cooler, smaller, faster 

4. Instruction repertoire 

5. Limited vs. modular design 
II. NUMBER SYSTEMS 

A. Basic Terms 

1. Sum 

2. Product 

3. Factor 

4. Base of number system 

B. Exponentiation 

1. Base 

2. Exponent 

3. Order of operations 

C. Number Systems Symbols 

1. Decimal 

2. Binary 

3. Octal (triads) 

4 . Hexadecimal (quadrads) 

D. Calculations and Exercise 

1. Expansion 

2. Addition 

3 . Comp lementat ion 
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III. BASIC COMPUTER COMPONENTS (ELEMENTS/UNITS) 

A. Definition of CPU 

B. Storage (Memory) 

1 . Word 

a. Data 

b. Instruction 

2. Memory register (cell) 

3. Bits (are located) 

4. Location (address) 

5. Bytes 

6. Number of stored locations 

7. "K" concept 

8. Word length 

9. Types of memory (internal storage) 

a. Core (ferrite) 

b. Thin film 

C. Arithmetic Unit 

1. Accumulator 

2. Memory image transfer 

D. Control Unit 

1. Memory buffering 

2. Parity 

3. Cycles 

a. Machine 

b. Instruction 

c. Execution 

54 



E. Input/Output Units 
IV. COMPUTER SYSTEM AND PERIPHERAL UNITS 

A. Criteria for Evaluating Storage Devices (capacity--speed--reliability- 
cost--power requirements--physical size) 

B. Common Types of External Storage Media 

1. Punched cards 

a. Binary 

b. Symbolic 

c. Hollerith code 

2. Magnetic tape 

3. Magnetic drums 

4. Disks 

5. Paper tape 

C. Input/Output Configuration 

1. Cards via card reader and punch (I/O) 

2. Magnetic tape via tape unit (I/O) 

3. Magnetic drums (I/O) 

4. Disks (I/O) 

5. Paper tape via paper tape reader and punch (I/O) 

6. Electric typewriter (I/O) 

7. Console (keyboard = I, CRT = 0) 

8. Printer (paper - 0) 

D. Definitions 

1. Reading 

2. Writing 
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E. Control Units 

F. Timing 

1. Millisecond 

2. Microsecond 

3. Nanosecond 
4 # Access time 
5. Add time 

G. Access Types 

1. Direct 

2. Sequential 
DATA REPRESENTATION 

A. General 

1, Media specific 

2. Types of transfers 

B. Binary 

C. Codes 

1. BCD 

2. EBCDIC 

D. Bytes 

1. Hexadecimal machine 

2. Octal machine 

E. Fractional Number Representation 

1. Fixed point 

2. Scaling 

3. Floating point 
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a. Advantages 

b. Disadvantages 

VI. PROGRAM DESIGN 

A, System Establishment 

1. Customer (CU) . 

2. Formulator (F) . Functional Area Analyst 

3. Designer (D) . Data Systems Analyst; Design Specialist, 

a. Flow chart 

b. Decision table 

4. Coder (CO). Programmer Specialist 

5. Machine (M) . Data Processing Machine Operator 

B. Flow Charting 

1. Types 

a. General system, MACRO 

b. Detailed program, MICRO 

2. Advantages 

3. Conventions (standard symbols) 

VII. PROGRAMMING LANGUAGES 






A. Machine Language j 

B. Symbolic Code; Mneomonic Operation Code 
1. Instruction classes 

a. Arithmetic 

b . Sequence control 

c. Data movement 

d. I/O 

e. Comparison 
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2. Macro instructions; library routines 

C. Assembler 

1. Source program 

2. Object deck 

D. Procedure Oriented Language 

1 . FORTRAN 

2. COBOL 

E. Compiler 

1. Generator 

2. Translator 

F. Report Program Generator 
VIII. OPERATING SYSTEMS 

A. Definitions 

B. Functions 

C. Utility Programs 

D. Types 

1. Batch processing; job stacking 

a. Computer job shop (closed shop) 

b. Supervisory time 

c. Turnaround time 

d. Throughput 

e. Operating efficiency 

2. On/off line 

3. Time sharing; Multiprogramming 

a. Advantages 

b . Background , foreground 
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E. Third Generation 

a. Industrywide 

b . Advantages 

IX. INTRODUTION TO B 3500 SYSTEM 

A. B 3500 system 

1. Modularity 

2. Third generation 

3 . Mul tiproces s ing 

B. Software 

1. Operating system 

a. Master control program 

b. Functions of MCP 

2. Compiler 

a. FORTRAN compilers 

b. COBOL compilers 

3. Others 

a. Advanced assembler 

b. Advanced sort generators 

c. Auxiliary programs 

C. Base Level Components 

1. Central processor 

a. Display panel 

b. Control panel 

2. Console printer and keyboard 

3. Core memory modules (Raffig^) 
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4. Peripheral equipment (Diagram) 

a. Card reader 

b. Card punch 

c. Magnetic tape units (MTU) 

d. Disk storage unit 

e. Line printer 

5. Remote terminals 

D. Arithmetic Capability 
1 . Fixed point 

2. Floating point 

3. Decimal machine 

E. Data Representation 

1. Bytes 

a. Two digits 

b. Eight bits = two digits 

c. Two bytes - one word 

d. Addressing = % byte (digit) 

2. ASCII 

3. BCL 

4. EBCDIC 

X. PERIPHERAL EQUIPMENT- -LOW DATA RATE 
A. Card Reader 

1. 800 CPM 

2. Under the control of an I/O control unit 

3. Reads column by column beginning with 1 
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4. Interchangeability 

5. Card Hopper- -capacity 2400 cards 

6. 9s row down and facing in 

7. Reading station 

8. Ends in a stacker 

9. Control panel switch/indicators 

a. Power on/Power off 

b. Start/Stop 

c. Not ready 

d. Feed check 

e. Validity check 

f. End of file 

g. Reset 

h. Validity on 
i. Read check 
10. Hands on training 
B. Card Punch 

1. 300 CPM 

2. Hopper holds 500 cards 

3. Placement - 12 edge down and in 

4. Follow block 

5. Punch and post punch read stations 

6. Stackers 

a. Primary 

b. Error 

c. Auxiliary 
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7. Control Panel Switch/Indicators 

a. Power on/Power off 

b. Start/stop 

c. Not ready 

d. Feed check 

e. Punch check (on) 

f. Runout 

g. Reset 

8. Hands on training 
C. Line Printer 

1. 1100 LPM/high speed slew 

2. 132 PP 

3. Forms 

4. Control Tape 

a. Feeding and spacing 

b. Changing 

5. Control panel switches/indicators 
a. Power on/Power off 

b # Skip to heading 

c. Ready /Not Ready 

6. Duplicate switches/indicators 

7. Hands on training 
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XI. PERIPHERAL EQUIPMENT- -HIGH DATA RATE 
A. Magnetic Tape Units 

1. Types 

a. Free standing - 9391 

b. Clustered - 9381 

2. Reels 

a. Take-up 

b. Supply 

c. Size 8% n and 10 11 

d. Ring 

3. Load Point 

4. End of tape 

5. Speed 

a. Normal 

b. Highspeed rewind 

6. Reading—either direction 

7. Mounting procedures 

8. Control panel switch/indicators 

a. Unit designator 

b. Power on/power off 

c . Load 

d. Unload 

e. Local 

f. Remote 

g. Write ring 
h . Rewind 

i. Density 
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9. Button actions 

a. Load 

b . Rewind 

c. Unload 

10. Hands on training 

B. Disk File Electronics Unit (DFEU) 

1. Controls the disk file modules 

2. Control Panel switch/indicators 

a. Power on/Power off 

b. Not ready 

c. DC on/DC off 

d. Master lockout 

e. Disk lockout 

C. Disk File Modules 

1 . Physical characterisitics 

a . Nonremoveab il i ty 

b. Total capacity 

c. Tracks per disk 

d. Segments per track 

e. Number of disks 

2. Types of .... (logical) 
a. System disk 

1) MCP 

2) Tables and directories used by MCP 
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b. Users disk 

1) Programs 

2) Data files 

3) Compilers 
3. Files 

a. Permanent 

b. Temporary 

XII- OPERATORS CONSOLE AND SUPERVISORY PRINTER/KEYBOARD - 9340 

A. Printer /Keyboard 

1. Acronym SPO 

2. Specifics 

a. CTRL 

b. ENQ 

c. ETX 

d. NAK 

e. Power switch 

3. SPO operating procedures 

a. Start operations 

b. Erase message 

c. Terminate message 

B. Operator 1 s Console 
1. Display Panel 

a. Nixie tube 

1) Number representation 0-5 
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a. Digits 0-9 

b. Undigits 0-5 

c. Hexadecimal equivalence 

b. Left Group 

1) OP AF BF 

2) Memory address 

3) Program address 

c. Right Group 

1) Instruction address 

2) Memory information 

3) Base 

4) Limit 

2. Channel indicators 

3. Fixed message displays 
C. Control Panel 

1 . Keys 

a. Information entry (16) 

b. Power on/off switches 

c. Display control and information entry (13) 

1) CL 

2) LD 

3) STOP /RUN 

4) SI 

5) OP 

6) A,B,C 
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7) PA 

8) AD 

9) WR 

10) Skip 

11) Read 

12) Emerg. Pull Off 

13) Term 

2) Normal 

3) Universal load 

XIII. SYSTEM SOFTWARE AND INTERVENTION (Part 1) 

A. Definitions 

1. Disk directory table 

2. Scratch tape 

3. Breakout 

4. System log 

5. File opening 

B. System Load Procedures 

1. MCP loaders 

a. Simple start 

b. Cold start 

2. System loader control deck 
a. Cold start control cards 

1) Required cards 

2) Optional cards 
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b. Start requiring replacement of the MCP (simple loader) 

1) Required cards 

2) Optional cards 

3) Required sequence of cards 

c. Program control cards 

1) Compile 

2) Execute 

3) Remove 

4) Dump 

5) Load 

6) Change 

7) Label 

8) Data 

9) Restart 

10) Unit 

11) End 

d. Program parameter cards 

1) Priority 

2) File 

3) Core change 

4) Value 

5) Charge 
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XIII. SYSTEM SOFTWARE AND INTERVENTION (Part 2) 

A, System Output Messages 

1. Format differences 

a. Messages requiring operator action 

b. Messages signaling discontinuation of a program 

c. State of processing messages 

2, Message categories 

a. Errors 

1) Hardware 

2) Data 

3) Program 

b. Requirements 

1) Peripheral 

2) Data 

c # Results - MCP response to query 

1) Input query messages 

2) Input commands 

3) Options 

B. Introduction of Data and Program Files into the System 

1 . When they can be introduced 

2. How they can be introduced 
a. Data 

1) Card files in reader 

2) Pseudo card decks 

3) SPO input messages 
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b. Programs 

1) Program scheduled 

2) Operator scheduled 

3. Mix versus Schedule 

4. Precedence link feature 

a. Purpose 

b. Method of using 

5. Pseudo card readers 

a. Purpose 

b. Messages pertaining to pseudo card readers 
C. Operator-System Interaction 

1. Inserting Control information - CC message 

2. Loading a program - LD message 

3. Unit status - OL message 

4. Control of Pseudo Card Readers - RN message 

5. Removal of control decks - RD message 

6. System options 

a. Enabling options 

b. Disabling options 

c. Messages involving options 

7. Log maintenance 

a. Operator response to MCP warning messages 

b. System response to operator answer 

8. Using the mix index-MX message 
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9. Interrupting programs 

a. BK message 

b. BR message 

10. Restarting programs - RB message 

11. Suspending - terminating programs 

a. RS message 

b. DS message 

c. ST message 

d. Reasons for suspending 

12. Reinstating a suspended program 

a. OK message 

b. GO message 

13. Additional system operator actions 

a. WS message 

b. RS message 

D. Program Failure and Debugging 

1. Detection of program failure 

a. Repeated output messages 

b. Opening and closing files 

c. Exceeding time required for execution 

2. Memory dump 

a. DM message 

b. DP message 

3. Program trace 

a. GT message 

b. NT message 

71 



COURSE OBJECTIVES 

I. ORIENTATION AND INTRODUCTION TO COMPUTER CONCEPTS 

1 # To be able to identify the following statements as being true: 

a. Computers don't think. 

b. Computers are controllable instruments of man. 

2. To be able to state that communication with the computer must be 
EXPLICIT. 

3. To be able to state that universal definitions of computer terms has 
not been accomplished, 

4. To be able to pick DATA BASE from a list of terms as being most 
resembling words such as 'dictionary 1 and 'encyclopedia. 1 

5. To state that INTERNALLY STORED PROGRAMS are the main way that a 
computer differs from a calculator. 

6. To be able to write PROGRAM when asked what machine instructions are 
called which tell the computer what you want it to do. 

7. To be able to pick COMPUTER OPERATOR from a list as being the person 
who is responsible for introducing the program into the machine. 

8. To be able to write the following terms when presented with their 
appropriate definitions. 

a. Hardware - The pieces of equipment which make up the physical 

machine and all its components. 

b. Software - All of the non-equipment and non-personnel aspects 

of a data processing system. 

9. To be able to define the following abbreviations: 

a. DP--Data Processing 

b. EDPM--Electronic Data Processing Machines 

c. EAM--Electronic Accounting Machines 

d- PCAM- -Punched Card Accounting Machines 

e. EDP--Electronic Data Processing 

f . ADP--Automatic Data Processing 
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10. To identify EDP and ADP as being synonymous. 

11. When presented with terms such as card sorter, interpreter, or collator, 
can identify these as being PCAM rather than EDPM. 

12. Demonstrate the ability to match: 



a. 


Babbage 


Father of computers 


b. 


Hollerith 


Punched cards 


c. 


World War II - 


Advent of electronics 


d. 


UN I VAC 


Commercial 



13. Ability to differentiate the three types of computer Generations by 
the use of the following key words... 

a. 1st - Tubes 

b. 2nd - Transistors (solid state) 

c . 3rd - Micro-miniaturization 

14. Can demonstrate the ability to match: 

a. Digital computer - counts 

b. Analog computer - measures 

15. To supply the term HYBRID as being a combination of a digital and an 
analog computer. 

16. To be able to pick VERSATILITY from a list as being the key word which 
differentiates the general purpose from the special purpose computer. 

17. Can list two advantages of a solid-state computer. These two 
advantages must be from the following list: 

a. Faster 

b. Smaller 

c. Less heat 

18. To be able to pick out the statement 'What the computer can do 1 from 

a list of statements in answer to the question "What is the INSTRUCTION 
REPERTOIRE of a computer? 11 
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19. To be able to pick out that 3rd generation computers contain both 
scientific and commercial instructions as part of their instruction 
repertoire. 

20. To fill the word MODULAR as being the type of design to which components 
can easily be added. 

II. NUMBER SYSTEMS 

1. Ability to define BASE of a number system as being the total amount 
of different symbols used in that system. 

2. To be able to state that: 

a. SUM refers to addition 

b. PRODUCT pertains to multiplication 

c. FACTORS are the same as numbers/symbols 

3. To be able to identify, in the expression b**n, that n is called the 
EXPONENT (POWER) and that b is called the BASE. 

4. To be able to define the nth power of a number b as: ! b multiplied 
by itself n times. 1 

5. To be able to work any simple problem reflecting that the 0th power 
of a nonzero number equals one, (e.g., b**0=l for any number b, 
other than zero, since 0**0=0). 

6. To be able to list the highest symbol for the following number systems: 

a. HEXADECIMAL -0 123456789ABCDEF 

b. DECIMAL -0 123456789 

c. OCTAL -0 1234567 

d. BINARY -0 1 

7. Write HEXADECIMAL as being the number system that is used in most 
third generation computers. 

8. Is able to pick from a list, the correct order of arithmetic operations. 
The correct order is as follows: 

a. EXPONENTIATION 

b. MULTIPLICATION 

c. ADDITION 
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9. Is able to define TRIAD as a group of 3 binary digits and can convert 
and reconvert any Octal number to groups of triads. 

10. Is able to define QUADRAD as a group of 4 binary digits and can 
convert and reconvert any Hexadecimal number to groups of Quadrads. 

11. Given various combinations of symbols; state which number systems 
these symbols are: 

a. HEXADECIMAL 

b . DECIMAL 

c . OCTAL 

d . BINARY 

12. To be able to write any number of the following systems as a decimal 
number. 

a. HEXADECIMAL 

b . OCTAL 

c. BINARY 

13. To be able to add any two symbols in the following number systems. 

a. HEXADECIMAL (e.g., 9+B=14) 

b. OCTAL (7+6=15) 

c. BINARY (1+1=10) 

14. To be able to complement (via exercises) any symbol contained within 
the following numbering systems. 

a. HEXADECIMAL 

b. DECIMAL 

c . OCTAL 

d. BINARY 

15. To be able to state that most computers subtract by the method of 
comp 1 ement add i t ion . 
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III. BASIC COMPUTER COMPONENTS (ELEMENTS /UNITS) 

1. To be able to define CPU as standing for Central Processing Unit. 

2. To be able to list. . . 

a. Storage (memory) 

b. Arithmetic unit 

c. Control unit 

as constituting the CPU. 

3. To be able to fill in the empty boxes when presented with a 
diagram of computer components (elements/units) . 

a . S torage (memory) 

b. Arithmetic unit 

c. Control (executive) unit 

d. Input unit 

e. Output unit 

4. To be able to state STORAGE (memory) elements in the computer 
component in which all data must be placed before being processed 
by the computer. 

5. To be able to list: 

a. Data words 

b. Instruction words... 

as being the two types of words which are stored within the computer. 
(In terms of use) 

6. To be able to pick out the correct definitions for the terms: 

a. Word 

b. Register 

c. Address 

d. Location 

from a list of alternatives 
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7. To identify that a word is composed of BITS. 

8. To be able to define the acronym BIT as a binary digit. 

9. Ability to define BYTE as being a fixed number of BITS. 

10. Ability to match the following: 

a, 8 bits - Hexadecimal machine byte 

b. 6 bits - Octal machine byte 

11. To be able to pick from a list, the term THOUSANDS, when asked 
the usual number of memory registers contained in a computer. 

12. Given a list of letters, be able to pick the letter "K" as 
representing 1000. 

13. To be able to indicate that all the BITS which comprise a word 
have a unique number. 

14. To be able to list: 

a. Core 

b. Thin film 

as being the two basic types of memory (internal storage) . 

15. To select all of the following from a list as being characteristic 
of core. 

a. Shaped like doughnuts 

b. Extremely small 

c. Allow magnetization 

d. Ferrite 

16. To select 'magnetization occurring in either one direction or 
another 1 from a list of alternatives as being characteristic of 
an element of core. 

17. To be able to pick out THIN FILM as being the fastest, when 
presented with a list of storage media. 

18. Given a list of storage media, be able to pick out THIN FILM as a 
media not currently being used for bulk storage. 
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19. To be able to state ARITHMETIC as the unit which contains all the 
circuitry and registers necessary for the performance of any and 
all computations. 

20. To choose from a list, the term ACCUMULATOR, as that portion of 
the arithmetic unit which normally contains the results immediately 
following an arithmetic operation. 

21. To pick IMAGE from a list of words when asked what is transferred 
from memory. 

22. To supply the word CONTROL for the definition, 'a device used for 
management of the computers operations. 1 

23. To be able to list 2 of the following 3 points concerning a 
MEMORY BUFFER: 

a. The place where all data must pass on its way to and from 
memory . 

b. Where parity is checked. 

c. Where time buffering occurs. 

24. To be able to supply the word PARITY for the definition, 'hardware 
feature which allows one to detect inaccurate data transfers. 1 

25. To be able to supply the word PARITY ERROR in describing what the 
above inaccurate data transfers are termed. 

26. To be able to match: 

a. Machine cycle - a fixed interval of time in which a 

computer operation occurs. 

b. Instruction cycle - the cycle in which the operation to be 

performed is brought into the control 
section and examined. 

c. Execution cycle - cycle during which the operation is 

carried out. 

27. To be able to define the acronym I/O. 

28. To be able to pick out I/O UNIT from a list of terms as being a 
device which operates under the control of the CPU and is used to 
transmit data to and from internal storage. 
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IV. COMPUTER SYSTEM AND PERIPHERAL UNITS 

1. To be able to list 3 of the 6 criteria for evaluating storage 
elements. The list is as follows: 

a. Capacity 

b. Speed 

c. Reliability 

d. Cost 

e. Power requirement 

f. Physical size 

2. Be able to list 4 of the following 5 common types of external 
storage media. The 5 media are: 

a. Punched cards 

b. Magnetic tape 

c. Magnetic drums 

d. Disks 

e. Paper tape 

3. To be able to associate: 

a. Binary card - image of memory. 

b. Symbolic card - punches on cards which represent letters, 

numbers, and symbols. 

4. When asked what code is punched on a card via a keypunch, the 
student must be able to pick out HOLLERITH from a list of words. 

5. To pick out MAGNETIC TAPE from a list of storage media as being 
where more data axe probably stored than any other place. 

6. Give a partially completed diagram of INPUT/OUTPUT configuration, 
the trainee is able to write in the names of various media and 
devices into the appropriate blank boxes. 
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7. To be able to match the following: 

a. Reading - information transferred from external equipment 

to memory. 

b. Writing - information transferred from memory to external 

equipment. 

8. To select the writing of a core image out on some media as opposed 
to losing what was contained in the core registers, etc. from a 
list of alternatives as characteristic of 'core dump 1 . 

9. To relate the I/O devices 1 ability to transmit data as being MUCH 
SLOWER than the CPU's ability to process the data. The choices 
are: 

a. Faster 

b. About the same 

c. Slower 

d. Much slower 

10. Identify that more than one line is the characteristic of MULTI- 
CHANNEL I/O. 

11. To pick CONTROL UNIT from a list of terms when asked what the name 
of the device is which is used in conjunction with multiple 
channels to relieve the I/O bottleneck. 

12. To be able to match the following: 

a. Millisecond - thousanth of a second 

b. Microsecond - millionth of a second 

c. Nanosecond - billionth of a second 

13. To be able to match the following: 

a. Access time - getting and putting back information from 

storage to memory 

b. Add time - accumulate or perform a simple addition 

computation • 
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14. To be able to match the following: 

a. Direct Access - Core, Drum, Disk 

b. Linear (Sequential) Access - Tape 
DATA REPRESENTATION 

1. Is able to match the following input media with associated methods 
of physically presenting data. 

a. Punched Cards - The presence or absence of rectangular holes 

in specific locations. 

b. Paper Tape - The presence or absence of small circular 

holes . 

c. Magnetic Tape, - The presence or absence of magnetized 
Drums and Disk spots (BITS arranged in specific patterns) . 

2. To be able to recognize all of the following as being ways data are 
transferred, even though representation may be different. 

a. Punched cards to magnetic tape. 

b. Magnetic tape to punched cards 

c. Paper tape to disk 

d. Magnetic tape to drums 

e. Disk to paper tape 

3. To be able to pick out BINARY as being the way data are stored in 
most computers. 

4. To be able to define EBCDIC as "Extended Binary Coded Decimal 
Interchange Code. 11 

5. To be able to match the following: 

a. BCD - The system that uses 6 BITS to represent numbers 

and letters. 

b. EBCDIC - The system which uses 8 BITS to represent more 

characters . 
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6. When asked what 2 forms of encoded data can be contained in a 
BYTE or a HEXADECIMAL machine, the trainee can respond... 

a. 1 EBCDIC character 

b. 2 Hexadecimal digits 

7. When asked what 2 forms of encoded data can be contained in a BYTE 
on an OCTAL machine, the trainee can respond... 

a. 1 BCD character 

b. 2 Octal digits 

8. Is able to encode and decode alphanumeric information expressed 
in. . . 

a. BCD 

b. EBCDIC 

This will be able to be accomplished by direct lookup, as this 
information will be presented in tabular form with supplementary 
panels. 

9. To supply the word FIXED POINT when given the statement 'A format 
in which the programmer is concerned about the location of the 
decimal (binary) point within the machine . ! 

10. To state SCALING as the process by which the programmer allocates 
the above mentioned point. 

11. To supply the word FLOATING POINT when given the statement 'A for- 
mat in which the computer itself allocates the exact position of 
the decimal (binary) point . ' 

12. To be able to identify the following 3 as being advantages of 
FLOATING POINT over FIXED POINT. 

a. A larger range of numbers can be presented. 

b. Greater accuracy can be acquired in computation. 

c. Numbers with different decimal (binary) points can be added 
without the programmer having to scale. 
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13. To be able to pick out SLOWNESS, in terms of machine time, as 
being the major disadvantage of floating point arithmetic. 

14. To be able to match: 

a. Fixed Point - Commercial computer 

b. Floating Point - Scientific computer 
VI. PROGRAM DESIGN 

1. To be able to list the five ingredients for system establishment. 
They are: 

a. Customer 

b. Formulator 

c. Designer 

d. Coder 

e. Machine 

The prompts Cu, F, D, Co, and M, will be present. 

2. To be able to equate the following in column A with column B, 
followed by column B with column C. 

A B C 

a. Cu - Has a need 

b. F Writes specifications - Functional Area Analyst 

c. D Design the system - Data Systems Analyst/ 

Designer 

d. Co - Puts into machine instructions - Programmer Specialist 

e. M Does it - Data Processing Machine 

Operator 

3. To be able to list both methods available to the Data Systems 
Analyst for performing his task. The two methods are: 

a. Flow charting 

b. Creating decision tables 
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4. To be able to write the words FLOW CHART when asked what a given 
diagram is. The diagram will be a simple flow chart. 

5. When given the definition "the graphic representation of what is 
to be accomplished during the flow of data through a program 
system 11 , the system is able to respond SYSTEM (MACRO) FLOW CHART. 

6. When given the definition "the graphic representation of how various 
procedures and decisions accomplish the task of the program system, 11 

the system is able to respond PROGRAM (MICRO) FLOW CHART. 

7. To be able to match... 

a, General/System flow chart with macro 

b. Detailed/Program flow chart with micro 

8. To be able to pick from a list the following three advantages that 
result from the preparation of a program flow chart before coding 
of a program begins: 

a. Logical error detection 

b. Eases program modifications 

c. Facilitates subdivision of computer programs 
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9. To be able to match the following symbols on the left with the 
statement on the right. 



( ) 



Start, stop, halt 



Processing 



c. 




Decision or branch 



o 



Connector or step operation 



e. 



Line of flow 



Card read or punch 
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Magnetic tape operation 




Paper tape operation 



Direct Access Storage 
(Disk, Drum, etc) 



J. 



Printed document 



VII. PROGRAMMING LANGUAGES 

1. To be able to define the following abbreviations... 

a. COBOL - Common Business Oriented Language 

b. FORTRAN - Formula Translation 

c. RPG - Report Program Generator 

2. To be able to pick out Machine Language from a list when asked, 
"What is made up of l's and 0's?" 

3. To be able to supply the term SYMBOLIC CODE when asked what machine 
specific instructions are used by the Programmer Specialist to represent 
each machine operation. 
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4. Identify 'symbolic code' and 'mnemonic operation code 1 as being 
the same thing. 

5. List the following 5 basic instructional classes. 

a. Arithmetic 

b. Sequence Control 

c. Data Movement 

d. I/O 

e. Comparison 

6. Pick out MACRO INSTRUCTIONS when asked what M a single instruction 
which can accomplish specific functions which actually requires 
many machine instructions ," ace called. 

7. Can pick out MACHINE ORIENTED LANGUAGE from a list as being 'the 
programming language in which the programmer uses symbolic coding 
and macro instructions'. 

8. Can pick out ASSEMBLER from a list when asked what converts from 
symbolic to machine language. 

9. Ability to match the following: 

a. Source program - That which is input to the assembler/ 

compiler. 

b. Object deck - The Machine Language Program that is 

the output of the assembler/compiler. 

10. To be able to equate object deck with a loadable application 
program. 

11. To pick PROCEDURE ORIENTED LANGUAGE from a list when confronted 
with the definition, "a higher order, user oriented language. 1 ' 

12. When presented with the following statements, the student is able 
to pick the proper language type: 

a. Does not require detailed machine knowledge -Procedure 
Oriented Language. 

b. Simplifies transfer of programs from computer to computer - 
Procedure Oriented Language. 
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c. Easiest for program maintenance and modification - 
Procedure Oriented Language. 

d. Most efficient use of computer storage - Machine Oriented 
Language. 

13. To be able to state that FORTRAN and COBOL are Procedure Oriented 
Languages. 

14. Can pick out COMPILER from a list when asked what converts from a 
Procedure Oriented Language to a Machine Language. 

15. Be able to name the two basic phases of a compiler. They are... 

a. Generator 

b. Translator 

16. To be able to match the following: 

a. Generator - Gives Intermediate Language 

b. Translator - Gives Machine Language 

17. To select RPG from a list when confronted with the following 
definition: 

VIII. OPERATING SYSTEMS 

1. To be able to write OPERATING SYSTEM for the definition 'The Set 
of Control and I/O Routines which Govern the Initiation and 
Operation of Programs 1 . 

2. To be able to recognize all of the following... 

a. Application programs of the computer installation. 

b. COBOL compiler 

c. FORTRAN compiler 

d. RPG 

e. UTILITY PROGRAMS 

as being programs which run under the control of an operating 
system. 
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3. To be able to pick UTILITY PROGRAMS as routines which function 
under the control of an operating system and relieve the computer 
user from writing new routines to perform standard data processing 
tasks , 

4. To be able to identify the following as being examples of Utility 
Routines: 

a. Sort/Merge 

b. Tape copy 

c. Memory print 

d. Card to tape 

5. To correctly match the interaction of the application program with 
the following: 

a. Operating System - continuously. 

b. Compiler/Assembler - only when must be modified. 

c. Utility Program - only when specific functions are to be 

accomplished. 

6. To match the typical origin of the following programs: 

a. Operating Systems - manufacturer supplied. 

b. Compilers - manufacturer supplied. 

c. Utility Programs - both manufacturer and user supplied. 

d. Application Programs- user supplied. 

7. To pick ON-LINE as the use of peripheral equipment or devices in 
a system in which the operation is under the control of the CPU. 

8. To pick OFF-LINE from a list of terms as being the use of peripheral 
equipment or devices not tied to 

9. To be able to write the words BATCH PROCESSING/ JOB STACKING when 
confronted with the definition, f a stack of jobs that runs one 
after another. 1 

10. When asked for the salient feature of the COMPUTER JOB SHOP, the 
student can pick out the statement, 'took the user away from the 
computer. ' 
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11. To be able to pick out SUPERVISORY TIME from a list of terms as 
being when the user has direct contact with his program at the 
computer. 

12. To write TURNAROUND TIME in response to being asked what the 
minimum amount of time for getting a job in and back is called. 

13. To write THROUGHPUT when asked what the amount of computer work 
accomplished in a given time period. 

14. To equate OPERATING EFFICIENCY with the percentage of time the 
computer is in operation versus the amount of time it is idle due 
to being set up. 

15. Give a list of statements concerning TIME-SHARING/MULTI-PROCESSING, 
to be able to pick out simultaneous use of a computer by multiple 
user as being the best statement. 

16. To be able to list 3 of the following 6 advantages of time-sharing. 

a. Cost is shared by many users. 

b. Pay only for what you use. 

c. Maximum use is made of the computer. 

d. User brought back to the machine. 

e. Manpower is saved. 

f. Turnaround time reduced for many users. 

17. To be able to match the following: 

a. BACKGROUND - programs running in a batch mode under a multi- 
processing system. 

b. FOREGROUND - those programs that are run in an on-line mode. 

18. To be able to identify THIRD GENERATION as the era of industry-wide 
time-sharing or multi-processing. 

19. To be able to pick out the following as being advantageous of 
third generation computers over those of first or second. 

a. Greater reliability. 

b. More computer power for the same amount of money. 

c. Ability to emulate older machines. 

d. Areas of storage now protected from other users. 

90 



IX. INTRODUCTION TO B 3500 SYSTEM 

At the completion of Lesson IX, the trainee should be able to: 

1. Select MODULAR DESIGN over LIMITED DESIGN as descriptive of the 
B 3500. 

2. Pick from a list of computer generations, the third generation as 
being descriptive of the B 3500 system. 

3. Pick out MULTIPROCESSING from a list as a characteristic of the 
B 3500 system. 

4. Supply the term MCP for the operating system used for the Base 
Level System. 

5. State that the abbreviation MCP stands for Master Control Program. 

6. Identify the following as the standard functions of the MCP. 

a. Loading and executing of user programs in a time-sharing 
environment . 

b. Allocating main memory to programs and relocating user 
programs when required. 

c. Maintaining disk files. 

d. Providing communication between operator and user via 
typewriter/keyboard units. 

7. Pick FORTRAN and COBOL from a list as the two compilers which are 
available for the B 3500 system. 

8. Pick all of the following as available for the B 3500 system. 

a. Advanced Assembler. 

b. Advanced Sort Generators. 

c. Auxiliary Programs. 

9. Indicate CONTROL and DISPLAY as the two types of panels of the 
Central Processor used by the computer operator. 

10. Pick SUPERVISORY PRINTER/ KEYBOARD from a list as the device used by 
the Computer Operator for communication with the MCP. 
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11. Pick 10j2fk or 15J2(fc as the amount of bytes of core memory of the 
BASE LEVEL system depending upon its level. 

12. List five pieces of peripheral equipment used in the B 3500 system. 

a. Card Reader. 

b. Card Punch. 

c. Magnetic Tape Units. 

d. Disk Storage Unit (IAS). 

e. Line Printer 

13. Pick REMOTE TERMINAL from a list as the way the user communicates 
with the MCP and programs in a multiprocessing mode. 

14. State that arithmetic capability consists of both Fixed Point and 
Floating Point arithmetic. 

15. Pick decimal arithmetic from a list as the arithmetic mode of 
operation of the B 3500 system. 

16. State that in a B 3500 byte there are: 

a. Eight bits. 

b. One character. 

c. Two digits. 

17. State that two is the number of bytes which equals one computer 
word. 

18. To match one-half byte with addressing level within memory. 

19. Define the following acronyms: 

a. ASCII - American Standard Code for Information Interchange. 

b. BCL - Burroughs Common Language. 

20 . Mat ch the f ol lowing : 

a. EBCDIC 8-bit standard code for representing data 

within the machine. 

b. ASCII 7-bit opetional code for representing data. 
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c. BCL 6-bit code by which BCD data is encoded on magnetic 
tape by many other computers, such as the Burroughs 
B 263. 

X. PERIPHERAL EQUIPMENT - LOW DATA RATE 

At the completion of lesson 10, the trainee should be able to: 

1. Pick 800 CPM as the speed of the Base Level card reader. 

2. Pick CARD READER CONTROL UNIT as the peripheral device which controls 
the card reader. 

3. Pick READS COLUMN BY COLUMN BEGINNING WITH 1 from a list, when 
asked how the card reader interrogates a punched card. 

4. Pick 'cannot be varied for a given run 1 when asked about card 
length and thickness interchangeability for the card reader 
and punch. 

5. Respond CARD HOPPER, when asked what the part of the card reader 
is called where cards are loaded. 

6. Pick 2400 from a list as the capacity of the reader's hopper. 

7. Pick '9's row down, facing in 1 from a list when asked how cards 
are placed into the reader. 

8. State that a reading station is the place where the A PUNCHED CARD 
IS INTERROGATED. 

9. Pick the term STACKER from a list as referring to an unreraoveable 
tray used for holding cards in the same sequence in which they 
have been input to the card reader. 

10. List the following in sequential order: 

a. Hopper 

b. Reading station 

c. Stacker 

11. Pick 2400 from a list as the capacity of the card reader's stacker. 

12. Pick from a list 'leftmost card in the stacker' as the last card 
processed. 
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13. Type NOT READY as the indicator which lights when any of the three 
following conditions occur: 

a. Hopper empty. 

b. Stacker full. 

c. Card jam. 

14. Respond FEED CHECK when asked what indicator other than NOT READY 
lights when a card jams. 

15. State that START is the only switch which will extinguish the 
NOT READY indicator for both card reader and punch. 

16. State that START is the switch which allows the card reader to 
read cards under control of the B 3500. 

17. State that STOP is the switch which keeps the card reader from 
feeding cards. 

18. State that READ CHECK is the indicator which lights when read 
check circuitry detects an operational failure. 

19. Pick Attempting to read in an incorrect mode 1 and 'put card in 
reader incorrectly 1 . From a list as the kind of reading errors that 
will cause the illusion of a validity check indication. 

20. Respond VALIDITY ON as the switch which must be depressed prior to 
the possible indication of an invalid character read via the va- 
lidity check indicator. 

21. Pick 'none of the above 1 from a list of erroneous uses of the 
END OF FILE switch/indicator. 

22. State that RESET is the switch which clears all error indicators on 
the card reader. 

23. Pick '300' as the CPM of the card punch. 

24. Pick '500' from a list, as being the number of cards held by the 
hopper of the card punch. 

25. Pick f 12 edge down in 1 from a list as the correct placement of 
cards into the card punch. 

26. State the FOLLOW BLOCK is the device that is placed on top of 
the cards in the hopper to ensure proper feeding. 
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27. State that PUNCH STATION is where the card is held until it is 
punched. 

28. List the three types of stackers: 

a. Primary 

b. Error 

c. Auxiliary 

29. Pick ERROR STACKER from a list as the place where blank cards are 
forced that have befcn too long in the punch station. 

30. Pick from a list 'there is no effect 1 when asked what happens when 
cards are removed from the stacker during a card punch operation, 

31. State that START is the switch which causes one card to move from 
the hopper to the punch station. 

32. Type NOT READY as the indicator which lights when any of the 
following conditions occur; 

a. No card is punch station. 

b. Punch error. 

c. Any of the stakers full. 

d. Stop button has been puehed. 

33. State that FEED CHECK is the indicator (in addition to NOT READY) 
which lights when there is no card in the punch station as a result 
of a failure to feed or a card jam. 

34. State that PUNCH CHECK (in addition to NOT READY) is the indicator 
which lights when data, that should have been punched on a card, 
are omitted. 

35. State that RESET is the switch which clears the feed check and 
punch check error conditions. . 

36. Supply the terra RUNOUT when asked to name the switch which causes 
cards to pass through the card punch without being punched. 

37. Pick 1100 from a list as being the LPM of the 9245 line printer 
due to the high-speed slew. 
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38. Pick f 132 f from a list as being the number of print positions of 
the line printer. 

39. Pick PAPER from a list as being most closely related to FORM. 

40. Pick ' tape interchangeability , controls feeding operations , and 
controls spacing operations > ' from a list as characteristics of 
the line printer's control tape. 

41. State that NOT READY is the indicator which will light after any 
of the following conditions: 

a. End of paper. 

b. The pushing of the not ready button. 

c. Paper slews for more than one second. 

42. Pick 'causes the carriage to skip to the 1st punch in channel 1 

of the carriage control tape 1 from a list as the result of pushing 
the SKIP TO HEADING SWITCH. 

43. State that end of paper is the indicator that is reset by pressing 
the ready Switch. 

44. Pick from a list 'increases operator efficiency' as the purpose for 
duplicate switches and indicators at the rear of the printer. 

XI. PERIPHERAL EQUIPMENT - HIGH DATA RATE 

At the completion of lesson 11, the trainee should be able to: 

1. State that the abbreviation MTU stands for Magnetic Tape Unit. 

2. Pick from a list FREE STANDING and CLUSTERED as the two types 
of units available for the B 3500 system. 

3. Supply the word TAKE-UP in response to being asked what the per- 
manently located reel on the left-hand side of the free standing 
MTU is called. 

4. State that SUPPLY or FEED is the reel which is mounted on the 
right-hand side of the free standing MTU. 

5. Pick from a list the following as characteristic of clustered 
tape reels. 

a. Supply reel is mounted directly above the take-up reel. 

b. Take-up reel is permanently timed to accommodate tape feeding. 
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6. Pick all of the following as constituting that which could be 
found on a supply reel. 

a. Input data for a program. 

b. Blank tape - intermediary. 

c. Blank tape - to contain an output. 

d. Programs to be executed. 

7. Pick from a list 8^" and 10" as the reel sizes for the Base Level 
tape units. 

8. State RING to identify the plastic device placed into the back 
of a tape reel which allows new information to be written onto 
a tape. 

9. Respond LOAD POINT to identify the reflective marker placed on 
the tape at the beginning of a reel which signals where reading 
or writing starts. 

10. Pick END OF TAPE MARKER from a list as the reflective marker which 
signals the end of tape. 

11. Pick 90 IPS from a list as the normal drive speed of a FREE STANDING 
tape unit. 

12. Pick 3^ IPS from a list as the average high speed rewind speed of 
a FREE STANDING tape unit. 

13. Pick EITHER DIRECTION from a list as the method for reading a tape. 

14. Pick from a list the steps for loading a FREE STANDING tape and 
order them in the following sequence: 

a. Pull down glass door. 

b. Place reel onto feed hub. 

c. Snap down reel latch on hub. 

d. Connect end of tape to end of leader. 

e. Position follower arm. 

f. Push up glass door. 
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15. Pick UNIT DESIGNATOR as the leftmost indicator on the control panel, 

16. State that LOAD is the switch which causes the tape to be drawn 
into the vacuum columns and moved from left to right so that the 
beginning of the tape is at the read/write heads, 

17. State that UNLOAD is the switch that repositions the tape from 
load point to the beginning of the latch leader. 

18. State that REWIND causes the tape to move from right to left so 
that the beginning of tape is at the read/write heads. 

19. State that LOCAL is the switch which removes the tape unit from 
control of the B 3500 system. 

20. State that REMOTE is the switch which places the tape unit under 
control of the B 3500 system. 

21. Pick from a list 'Supply Reel has a ring and can be written upon 1 
as being descriptive of the WRITE RING indicator. 

22. Match DENSITY with the selector in the rightmost position of the 
MTU control panel. 

23. Pick from a list LOCAL-LOAD-REMOTE as the correct sequence of 
button actions when loading a tape and placing it under control of 
the B 3500 system. 

24. Pick from a list LOCAL-REWIND as the correct sequence of button 
actions taken when rewinding a tape. 

25. Pick from a list LOCAL-UNLOAD as the correct sequence of button 
actions taken when unloading a tape after the tape has been rewound. 

26. Define DFEU as standing for Disk File Electronics Unit. 

27. Pick from a list DISK FILE MODULES as the storage units which are 
controlled by the DFEU. 

28. Supply the terms MASTER and DISK when asked what the two kinds of 
write lockouts are. 

29. Pick ? the absence of a write ring 1 as most analogous to a write 
lockout condition on a disk unit. 
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30. State that NOT READY is the indicator which lights when any of 
the following conditions occur: 

a. Air pressure low. 

b. AC power off. 

c. DC power off. 

d. All disks not up to speed. 

31. Pick from a list NONREMOVEABILITY as a characteristic of the disks 
of a disk file module. 

32. Pick 10,00,$$$ as the byte capacity of a disk file module. 

33. Respond SEGMENT when asked what element of a disk module contains 
100 bytes of data. 

34. Respond TRACK when asked what element of a disk module contains 
25$ segments. 

35. Respond DISK when asked what constitutes l$$ tracks. 

36. Identify four as the number of disks contained in a disk file 
module. 

37. State that SYSTEM DISK and USERS DISK are the two categories into 
which disk storage is divided. 

38. Pick from a list MCP and the MCP TABLES /DIRECTORIES as comprising 
the SYSTEM DISK. 

39. Pick from a list programs, data files, and compilers as the contents 
of the USER'S DISK. 

40. State that FILES are related records which are treated by the user 
as being contiguous on the disk. 

41. State that TEMPORARY describes files which are normally used by a 
single program on a given run. 

42. State that PERMANENT describes files which may be used from job-to- 
job, or day-to-day. 
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XII. OPERATOR'S CONSOLE AND SUPERVISORY PRINTER/KEYBOARD - 9340 

At the completion of lesson 12, the trainee should be able to: 

1. Define the acronym SPO as ^Supervisory Printer On-line. 

Match the following: 

2. ENQ - A signal to the MCP that the operator wishes to input a 
message. 

3. ETX - End of transmission. 

4. NAK - Reset the entire line of this message. 

5. CTRL - Must be depressed in conjunction with special coded keys 
when they are to be used. 

6. PICK CTRL/ENQ from a list as describing the START operation. 

7. Pick from a list in the proper order the following ERASE operations: 

a. CTRL/NAK. 

b. Retype the entire message. 

8. Pick from a list CTRL/ETX as the operation to TERMINATE a message. 

9. Respond NIXIE TUBE when asked what the equipment is called which 
allows for the display presentation of two groups of six digits 
each. 

10. Respond DIGITS when asked what the symbols p through 9 are termed. 

11. Respond UNDIGITS when asked what the symbols ^ through 5 are termed. 

12. Respond Hexadecimal as the number system_which is equivalent to the 
extended number sets undigits through 5 and the digits through 9. 

13. Pick from a list: 

a. OP AF BF. 

b. Program address. 

c. Memory Address. 

...as that which can be displayed in the left group of the Nixie tube, 
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14. Pick from a list: 

a. Instruction address. 

b. Memory information. 

c. Base (register) Limit (register). 

...as that which can be displayed in the right group of the Nixie 
tube. 

15. Pick from a list 'channel is busy* when asked what is meant by 
illumination of a channel indicator. 

Match the following fixed message displays: 

16. NORMAL - Not in a control state operation 

17. ASCII - Indicates the processor is not operating on EBCDIC 

data. 

18. INTERRUPT - Logical interrupt not completed. 

19. PROGRAM - Invalid operation, address, or instruction time 

out interrupt. 

20. CHECK - Results from a parity interrupt. 

21. OVERFLOW - Can be caused by an invalid arithmetic operation. 

22. TEST - Lights each time the operator initiates the system 

from the start. 

23. Pick from a list 'the keys which represent the digits ff - 9 and 
undigits J^ - 5* as those which comprise the INFORMATION entry 
keys . 

24. Give the correct meaning of these abbreviations: 

a. CL - Clear 

b. LD - Load 

c. PA - Program Address. 

d. AD - Address. 

e. WR - Write 

f. SI - Single In 
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25. State READ when asked the name of the control key which permits 
the display of one to four digits starting at the memory address 
specified. 

26. State WRITE when asked the name of the control key which permits 
the entering of information into core memory one digit at a time 
starting at the memory address specified. 

27. State SKIP when asked the name of the control key which allows 
the bypass of a digit position when entering information into core 

memory . 

28. State that STOP/RUN is the key which: 

a. Stops the processor, or 

b. Causes the processor to continue execution of the stopped 
program. 

29. State that SINGLE IN is the key which causes the current 
instruction displayed in the Nixie tube to be executed and 
the next instruction fetched and displayed. 

Match the following: 

30. OP - Causes the current instruction and its address to be 

displayed in the Nixie tube. 

31. A,B,C - Causes the corresponding address field (A, B, or C) 

of an instruction to be displayed in the right group 
of the Nixie tube. 

32. PA - Allows the address of the next instruction to be 

displayed in the Nixie tube and changed if desired. 

33. AD - Used in conjunction with the read and write key to 

specify the location of the core memory address to 
be read or written. 

34. State that TERM functions the same as the clear keys except all 
I/O operations are stopped. 

35. Pick STOP/RUN from a list as the only key which is active whether 
or not the processor is halted. 

36. State that UNIVERSAL is the type of load which is used when the 
operator selects the channel and peripheral unit from which to 
load the system loader deck. 
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37. State that NORMAL is the other type of load. 

38. Pick from a list and order the following keyboard actions which are 
necessary for a NORMAL LOAD. 

a. CL 

b. LD 

39. Pick from a list and order the following keyboard actions which are 
necessary for a UNIVERSAL LOAD. 

a. CL 

b. AD 

c. WR 

d. Enter channel number and I/O descriptor digits. 

e. OP and the digits 660000. 

f. STOP /RUN 

XIII. SYSTEM SOFTWARE AND INTERVENTION - PART 1 

At the completion of lesson 13, Part 1, the trainee should be able to: 
Match the following definitions: 



1. Disk Directory Table 



Scratch 



Breakout 



System Log 



File opening 



Contains the absolute disk address and 
length of any program/data file that is 
a permanent file within the system. 

A magnetic tape that does not contain data 
relevant to any program and is therefore 
available as a storage medium. 

The interruption of processing of a given 
program. 

The table maintained by the MCP which con- 
tains all data relevant to management of 
the computing center. 

A function required of programs before any 
data within a file may be accessed. 
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6. Select the following from a list as the three prerequisites to 
B 3500 operation: 

a. MCP must be on disk. 

b. The Disk Directory Table must be on disk. 

c. The computer configuration must be detailed for use by 

the MCP. 

7. Select SIMPLE and COLD START as the two types of System Loaders 
that may be used to enable B 3500 operation. 

8. Select from a list the conditions which require the COLD START 
Loader to be used: 

a. Neither the MCP nor the Disk Directory Table exist on disk. 

b. The Disk Directory Table is to be wiped out. 

9. State that the SIMPLE LOADER is used only when a different version 
of the MCP is to operate with the existing Disk Directory Table. 

10. State that 'an illegal character in column one 1 is the method by 
which the MCP recognizes a control card. 

11. Select from a list in the correct sequence the following control 
cards required by the SIMPLE loader: 

a. System tape specifier card. 

b. Keyboard SPO channel card. 

c. Disk specification card. 

d. MCP version card. 

12. Select from a list those required, and optional control cards 
used as input to the COLD START Loader. The correct cards are: 

a. System tape specifier card. 

b. Data card. 

c. MCP version card. 

d. Channel cards (include keyboard SPO channel card). 

e. Unit cards. 
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f. Disk specification cards. 

g. Load card, 

h. Parameter and use (option) cards, 
i. File card groups, 
j. Stop card. 
Match the System Loader Control Cards with their uses: 



13. System Tape Specifier card 

14. Keyboard SPO channel card 

15. Unit card 

16. Disk Specification card 

17. Date card 

18. Use BOJ card 

19. Use EOJ card 



20. Use LOG card 



21. Use OPN card 



22. Use date card 



23. Use time card 



Specifies the location of the 
1 SYSTEM 1 tape. 

Specifies the channel to which 
the Keyboard SPO is attached. 

Specifies the peripheral devices 
and their locations for use by the 

MCP- 

Specifies the number of disk elec- 
tronic units and their address 
ranges for use by the MCP. 

Sets the date used by the MCP. 

Causes the MCP to print on the 
operator console a beginning-of- job 
message for each initiated program. 

Causes the MCP to print on the 
operator console an end-of- job 
message for each program that 
completes execution. 

Notifies the MCP that maintenance 
of the system log is required. 

Causes the MCP to print on the 
operator console a file open message 
each time a file is opened. 

Causes the MCP to request the date 
at each halt/load. 

Causes the MCP to request the time 
of day at each halt/load. 
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24. Use LIB card 



25. Use PBT card 



Causes the MCP to type on the SPO 
the library maintenance actions. 

Causes the MCP to use a printer 
back-up tape if the line printer 
is not available. 



26. Use Auto card 



27. MCP Specifier card 



Causes the printer backup files to 
be automatically printed when the 
file is released by the program 
and a line printer is available. 

Informs the MCP loader which MCP 
version to load onto disk. 



28. Load card 



Causes the MCP to be loaded into 
core. 



29. Stop card 



The last card of a Cold Start System 
Loader Control Deck. 



Match the Program Control Cards with their uses 
30. Compile card 



Identifies the translator (COBOL, 
FORTRAN) used to compile a source 
program and the type of compile to 
be made. 



31. Execute card 



32. Remove card 



33. Dump card 



34. Load card 



35. Change card 



36, 



Label card 



Calls a library program (permanent 
file) from disk for execution. 

Causes files specified to be erased 
from the Disk Directory Table. 

Causes one or more programs and/or 
data files to be copied onto a 
scratch tape from disk. 

Causes files named on the card to 
be loaded onto disk and entered in 
the Disk Directory Table. 

Causes the program and/or data file 
names to be changed. 

Relates a card file with a data file 
name and other information. 
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37. Data card - Relates a card file with a data file 

name only. 

38. Restart card - Causes the restart of a program from 

the breakout or interrupted point. 

39. Unit card - Causes the introduction of peripheral 

devices into the environment of the 
MCP. 

40. End card - Denotes the end-of-file for a given 

card file. 

41. Pick from a list the following five program parameter cards: 

a. Priority card - Assigns a priority value to the 

program. 

b. File card - Associates a data file name to the 

program. 

c. Core change card - Modifies core requirements of a 

library program after scheduling. 

d. Value card - Allows assignment of a 6-digit value 

at execution time to an address in 
the program's core area. 

e. Charge card - Assigns a charge number to log records 

of the program. 

42. Identify the following program control and parameter cards in the 
proper order. 

a. Compile or Execute card. 

b. Program parameter cards (if any). 

c. Program control cards in any sequence. 
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XIII. SYSTEM SOFTWARE AND INTERVENTION - PART 2 

At the completion of Lesson 13, Part 2, the trainee should be able to: 

1. State that those output messages preceded by '**' require operator 
action. 

2. State that those output messages proceeded by '--' signal the dis- 
continuation of the program. 

3. Type 'state of processing 1 as those output messages not prefixed 
by '**' or '--'. 

4. Select from a list the following three classifications as being 
the major categories of messages output to the System Operator by 
the MCP. 

a. Errors. 

b . Requirements . 

c. Results. 

5. Pick all of the following as constituting the types of error con- 
ditions output by the MCP. 

a. Hardware errors. 

b. Data errors. 

c. Program errors. 

6. When informed 'peripheral 1 is one type of requirement communicated 
to the operator by the MCP, indicate 'data* are the second. 

7. Select all of the following as System Operator/program functions 
to which the MCP responds with result messages. 

a. Input query messages. 

b . Input commands . 

c. Options set by a Program Control Card or the System Operator. 

8. Select 'at system load time or anytime thereafter 1 from several 
alternatives as when data can be introduced into the system. 
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9. Pick from a list the following as the three methods of introducing 
data into the system. 

a. Card files in the card reader. 

b. Pseudo Card Decks 

c. SPO input messages. 

10. Select 'object program 1 and 'System Operator 1 as the two ways in 
which a job may be scheduled for operation. 

11. Complete the sentence 'Pseudo Card Readers' enable the MCP to read 
data from disk and process it as if the data were in a CARD READER . 

12. State that the maximum number of Pseudo Card Readers is nine, 

13. Respond JRT or Job Reference Table when asked where the schedule 
of jobs waiting to be executed is maintained. 

14. Respond 'Mix 1 when asked where the information relevant to a job 
being executed by the MCP and associated tables is maintained. 

15. Respond ! 10' and ! 40 ! when asked what is the maximum number of 
jobs that can be in the mix and schedule, respectively. 

16. Respond 'precedence link' when asked what is the feature that 
permits the scheduling of a second program after the first program 
is completed. 

17. State that the 'execute card* is the means of using the precedence 
link feature of the MCP. 

18. Select '? EXECUTE (Program-Name) AFTER (Program-Name)' from a list 
as being the correct control card to schedule one program followed 
by another. 

19. State 'CC as preceeding the SPO input message that allows the 
System Operator to supply control information to the MCP. 

20. Respond ! LD U when asked what message permits the System Operator 
to initiate the on-site load control program. 

21. State 'OL' when asked what is the message that prints the status 

of all units on the channel indicated including Pseudo Card Readers, 

22. Pick ! RD ! as the message that is used to remove control decks from 
disk. 
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23. Supply 'RN' when asked what is the message used to indicate the 
number of Pseudo Card Readers needed, 

24. State that system options: 

a. May be caused to function both by System Loader Control Cards 
and by SPO input messages and 

b. May be enabled or disabled anytime after system load via SPO 
input messages . 

25* State 'TO' when asked what is the message used by the System 

Operator to request the typing of the status of the system options, 

26. Respond 'SO 1 when asked what message is used by the System Operator 
to set system options, 

27. Pick 'R0' as the message used to reset specified system options, 

28. Complete the sentence 'if the operator ignores the LOG FILE FULL 
message, the accumulated information will be LOST or PURGED . ' 

29. Supply 'LN' when asked what is the message that will cause the 
LOG file to be scheduled for printing by the program LOGGER (or by 
program LOGOUT in case LOGGER is not available) . 

30. Respond 'Mix index 1 when asked what is the pointer to a program 
that is used by the MCP to associate SPO input messages. 

31. State the 'MX 1 message causes the MCP to supply the operator 
with the mix index of all programs in the Mix Table. 

32. Respond ' BK' when asked what message is used to interrupt or 
breakout a given program, based on the occurrence of specified 
conditions. 

33. Pick 'BR 1 as the message that is used to interrupt or breakout 
a program unconditionally. 

34. Respond ' RB' when asked what message is used to restart a program 
interrupted either conditionally with the ' BK' or unconditionally 
with the 'BR 1 input message. 

35. Match the interruption and suspension of programs with the resulting 
action: 

a. Interrupted - The program is removed from the system 

and placed on a restart tape. 

b. Suspended - The program is removed from core and 

placed on disk until reinstated. 
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36. State that 'ST 1 is the message used to temporarily suspend a program 
by the System Operator. 

37. State a program can be temporarily 'suspended 1 when any one of the 
following conditions occur: 

a. No file available. 

b . Duplicate files . 

c. No user disk. 

d. Duplicate library. 

38. State that the 'OK' message is used to direct the MCP to continue 
program processing after it has been temporarily suspended due 

to MCP action. 

39. State that the 'GO 1 message is used to reinstate a program suspended 
by the 'ST 1 message. 

40. Supply 'DS' when asked what message allows the System Operator 
to terminate a program. 

41. State that the 'WS 1 message is used to request a list of those 
programs which are scheduled for execution by the MCP, but have 
not been loaded or initiated. 

42. Respond 'RS' when asked what message allows the System Operator 

to remove a schedule request for a program before it is initiated. 

43. Select from a list the following possible indications of program 
failure: 

a. Repeated output messages. 

b. Opening and closing the same files. 

c. Exceeding the time required for execution. 

44. State the 'DM' message causes a memory dump of the specified program 

to be output to the line printer and the program to continue processing. 

45. State the 'DP' message causes a memory dump to be listed on the 
line printer and the program to terminate. 

46. State the 'GT 1 message causes a trace of the object program as an 
aid to programmers in discovering program errors. 

47. State the 'NT 1 message discontinues the trace. 

Ill 



EXAMPLE OF LESSON MATERIAL FROM THE 
COURSE DESIGNER/TRAINEE VIEWPOINT 



The following example is extracted from Lesson 2 - Number Systems as executed 
by a trainee during the Phase II validation activity conducted at the STTC. 

The lesson as constructed by the course designer is presented on the left side 
of each page whereas the lesson as executed by the trainee is presented on the 
right side of each page. 

The example selected depicts a trainee who elected to take the pre-requisite 
test in an attempt to by-pass the lesson. After several frames, the program 
informs him that he has FAILED to pass this test. He is automatically branched 
to the start of the lesson and continues lesson execution from that point. 
Several more frames have been included to indicate his path through the lesson. 
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FRAMr 1.0 TYPr M1 LAR^L COO^OO 

G.2 TFXT 

1.0 IT. NIP'PFRSYSTFM^? 

2*.0 nn Ynit WT$h TO TakF TmTS I.FSSHKI HM MhMRFR $Y?TFM$ OR OH vnn ALRFAOY 

3*.0 '/NOW IMF mATFPT Al ? 

fl.3 AMSWFRS 

1 .0 A+YFc, p|L TAKE TT. 
2.0 P + Nlflf T KNOW IT. 

C, .4 ACTTQNS 

l'. a Fin.K. r : M n D ? 

2.0 q F;n,K.» LFT • S MA*F SHR^ . 



FRAmt 



?.0 TY°r 01 LAR r L 



G.? TFXT 

1*. tmf na<;F nF -s miimrcr sYS Tr M I <; nrr t Mrn A<; . . . 

G . 3 a N S w r R $ 

1.0 o set wfYtAiDRn ON 
2.0 o SET dhhmfttc ONi 
3.0 A+MUMRrW <;YMPnl.S 

* ". n p + njumrfr n I F" r r r t m t 
5.o r + TDTAi. <;vmrhl^ 

6.0 0+TOTAl HTFFr^FNT 



FRAMF 1.0 TYPF Q1 LARFL 



G.2 TFXT 

1.0 ? IS TMF 



nF 4 AND 1. 



a. 3 AMSWFRS 

1. n SET nROpP on 

2.0 A* SUM 

3.0 P+AOniTTOM 
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II. NUMBER SYSTEMS 



DO" YOU WISH "TO TAKE -TBIS-LES80N-ON NUMBER SYSTEMS-OR-DO-- YOU- ALREADY. 
KNOW THE MATERIAL? 

-AHBSy- TLL TAKB IT. 

B NO, I KNOW IT. 



b 

O.K., LET'-S-MAKE -SUGEgh 

THE BASE OF A NUMBER SYSTEM IS DEFINED AS 

~K 



the value of the second digit 
7 15 T H E ■..— -=- ..*—» OF k AND 3 r- 
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FRAmp 4.0 TYPf 01 LARFL 



G.2 TEXT 

1.0 1? Is THr 



Or 4 AND 3« 



G.3 ANSWFRS 

1 .0 A+PRnOllCT 



FRAuf 5.0 TYPF 01 LARFL 

6*2 TFXT 

1.0 (WF Will USr THr aStprISK •*' to TNDTCATF MULTIPLICATION)? 
2.0 TM TMF EVPRE^SION* 4*3*2«?a* IMF NIjmqfRS 4> 3* ANO 2 APF CALLFO 
3.0 -----------. 

fit 3 ANSWFRS 

1 .0 a+FATTOR^ 
2.0 A+FAO THR 



FRAMF 6.0 TYPF Ml LA«FL 

fi.2 TFXT 

1.0 WHAT TS TME NTH POWFO hf THE miimpfr r? 

fi . 3 ANSWFRS 

1.0 A+ P MU! TIPI.TFD RY TTSEl F N TTMTS. 

2.0 P M MULTIPI.IFO RY TTSEl F B TT^FS. 

3.o r p Annrn to n. 

4*. n P TIMFS M. 



FRAmf 7.0 TYPF 01 LARFL 

0.2 TEXT 

1.0 TN AM rXPPESSTnN WHTom RMSES R TO TgF NTH POWFR> f B' TS KWOWN AS 
2.0 TMF --- --..-- flPsi n »m» AS TT* ---.--, 

G • 3 ANSWFRS 

1.0 DROFR OFF 
2.0 A+RA^F EYPHNr^T 
3.0 Q+RASF POWER 
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12 IS THE OF U AND 3. 

— product" . 

product 
(WE WILL U 3E- 



'»' T0 -3MP-IC 



.1^ 3,- AND 2 ARK CATTED 



tenna 

-W HAT IS THE NTH -P OWER OF THB -3UMBER BT 
A B MULTIPLIED BY ITSELF N TIMES. 
-B N MJLTIPLIED DY ITSELF B TIME S . 



C B ADDED TO N. 
D B TIMES N. 



IN AN EXPRESSION WHICH RAISES B TO THE NTH BOWER, 'B' IS KNOWN AS 
TH E AND 'N' AS EPS . 



numbe r nu nfl rar pow er 
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FRAMF ^7.2 TYPp 01 LARFL NOGn? 

g.2 r.ONOTTinNs 

JiO CtYQii UM/F MTSSEH TOO MAMV KFY TTFM^ SO 
2.0 rtREOIITSTTE TFST WILL RE TFRMTNATFD a NO 
3*,0 c":igUMRFR SYSTEMS PRESTNTrn. 



FAR* THEREF0OF» TmF PPF- 
TMF flOllRSF MATFPTAL HNI 



FRAMF ^9.0 TYPr 01 LARFL MOD? 
r,.2 TEXT 



1.0 TT DUMBER SYSTEMS?? 

2'.0 CTVIl T7ED MAM NO LON^FR ^miNTS TMTNOS RY PUSMTNG OBJECTS AROUND. 

3'.0 TNSTrAD mf PUSHES AROUND 'SYMBOLS' no NUMRFRS WMTCM STAN* FOR OBJFTTS.' 

4*.0 CTVII. T7F0 COMPUTERS 41 50 MANtPULATF ---------- RATHFR THAN THTNGS. 



FRAMF 



^A.5 TY°F 01 LAP^L 



G.3 ANSwFPS 

1.0 n SET PHnvETTC ON 
2.0 SET ORHFR 1M 
3.0 * SET KEYWORn ON 
4.0 a+sYMRnL* 
5.0 A+NU^RFRS 

fit* ACT TONS 
1.0 ft R F ! 
2.0 -FINnTTCF TH^ 'A! SO'. C! 



FRAMr TO.O TYPF 01 LARFL 



0.2 TFX T 

l'.O twF CYMRni 5 USFD TN VARIOUS NUMRFR <;vSTEM^ ARE ARRITPAPY TM THAT TMFY 

2.0 APF MAN-MADE FOR OUR CON\/rNirNCF.? 

3,0 MiiMBfR SYSTEMS APF MADr iid OF ARRITAOY -----------, 

G.3 ANSWERS 

l'.O A+SYMROLS 

G.4 ACTIONS 

r. o a r $ 

2.0 -c i 
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YOU have missed TOO many key items so fab, therefore, the pre- 

-REQOISITE TEST -WII1.- BE TERMINA TED AND THE COURSE -MATERIAL ON - 
NUMBER SYSTEMS PRESENTED. 

H NUMBER SYSTEMS 



CIVILIZED MAN NO LONGER COUNTS THINGS BY RJSHING OBJECTS AROUND^ 
- HS- PUSHES AROU N D ' SYM B O LS* £R NUMBERS WHICH -STAND * 



CIVILIZED COMPUTERS ALSO MANIPULATE RATHER TH/X THINGS. 



-*- 



symbols 
CO R R E CT 



THE SYMBOLS USED IN VARIOUS NUMBER SYSTEMS ARE ARBITRARY IN THAT THEY 
ARE~MAN-i4ADE FOR" OUR 



NUMB E R Slg l' KMS AKK MADE UP OF AnDITARY — - 

symbols 

TRUE 
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FPAmt aO.O TY^r Q1 LARFL 

G.2 TEXT 

1.0 TM SrMnOL WE LFAPNFO COUNTING ANO ARITHMETIC WITHIN THF USUAL 
P'.O HFCIMAL MllMBTR SYSTEM, wp WFPF ACQUAINTED ALSO WITH SYMBOLS I IK** 
3*.0 T, iTf I T T ^ TV* rTC, WH^CH IN r.AFSAo'S TIME CONST T TUTTD THF 
4.0 -- - NIJMFRTC&L SYSTEM. 

G.3 ANSWFPS 
1 .0 A+PO^AN 

G.4 ACT TONS 
1 ". A F I 

2.0 ~c: 



FPAmt M.O TYPF 01 LARFL 

G*2 TFXT 

1.0 HUP FAMJI.TAR NIJMRFRTMf, S^^TEM HSFS TmF TFN SYMROLS? 

2.0 019345678 9.-> 

3.0 TT Ic 0A| LEO THE MiiMqrp cvsTEM. 

G.3 ANSwrPS 

1.0 A+OFT TMAI 
?\n p+aRaptC 

6.4 ACT TONS 
1.0 A F : 
2.0 q F : APART f Is FImF Riij wr WE&F JMTNJK'TNr, nr OFCTMAL. 

3.o - n t 



FRAur (i 9.0 TYPr 01 LARFL RASf 

fi.2 TFXt 

1.0 WF R^FFR TO THF TOTAL NIM'QFR OF OTFFrRFNT SYMBOLS IN A NUMQEPTNf, 
? • SYSTEM Ac THr * BASF f nr t MA t miimpfr ^YSTFm. ? 

3'. TMF nFCl M AL MUMBFPINr; <>y*tfM T*^ 'RA<;f tO» RFC AlJSC IT CONTAINS A 
4.0 TOTA! OF 10 OTFFrRTNT ----------- f 

fi . 3 A N S M F P S 

l".0 o SET phonETto 0* 
2 '. n n set hphfr on 
3.0 n SFT KEVwoRH ON 

4.0 A+SYMRHLS 



f,.4 ACTTONS 
1 ". A F ! 

2.0 -ps 

3.0 -ft 
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BT SCHOOL -WE LEARNED-COUNTING-AND ARITHMETIC WITHIN THE USUAL 
DECIMAL NUMBER SYSTEM. WE WERE ACQUAINTED ALSO WITH SYMBOLS LIKE 

i , ii, in, iv, ore, wnion m cae s ar' s T oc-r 

NUMERICAL SYSTEM. 



roman 

"COCD " 

OUR FAMILIAR NUMBERING SYSTEM USES THE TEN SYMBOLS 



0123^5678 9. 
IT IS CALLED THE — — NUMBER SYSTEM. 

• 

decimnl decimal 

O OI WECT — 

WE REFER TO THE TOTAL NUMBER OF DIFFERENT SYMBOLS IN A NUMBERING 
SYSTEM "AS THE 1 fiASE' OF THAT -NUMBER SYSTEM. 

-THE DECBfAL NUMBERI NG SYSTEM IS 'BASE 10* BECAUSE IT CONTAINS A 
TOTAL OF 10 DIFFERENT . 

• 

symbols 

~GOCfl> — — - 
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FR4MT '13.0 TYDr 01 LARFL 
G.2, TEXT 

r.o wr call this nhmqfr ^y^t^m ofctmal wm b^causf it has 'dfctmal points* 

?[. PUT qrf.AHSE OFClMAL COMFc FROM A LATTN WOpO MFANTNG TEN. JHT OECT^AL 
3*. SYSTrM HAS A BASF flF ---»-. fM||MRFP< ARF TMF PFRFFRPFO PFSPONSF). 

6.3 A N S W F R S 

r. o p * \ o 

2,0 A+TEM 

G«« ACT TONS 
1.0 AR Fi 

2 '. -fit 



FRAmt 44.0 TYPF 01 LARFL 



G.2 TEXT 

1.0 TMF • BAS* 7 • 0^ A MIJMRrp SYSTEM T S OFrTNFD AS TMF TnTAL 
2'.0 nTFFrprMT U<rO TN TmAT MIJMRFr SYSTEM. 



OF 



G . 3 A N S W F P S 

1*. o n R n r p nff 

2*.0 I+MIJMRTR SYMROLS 

fi.« ACTTONS 
1 ". *i Ft 
2.0 -Pi 

3*.0 -fi! 



FPAMF &5.0 TYPF Q1 l.ARFL 

G.2 TEXT 

1.0 MOTICF TMflT ALTHOUGH 9 M THE MTGHF<T FL r MFNTARY NIJMPFP TN TMF QFfiTMflL 
2*.0 SYSTTM, THERr ARF ACTllALlY »TFN» OT^FFPENT SYMROLS STNTF WF MIIST 
3".0 M WAYS IMCLHOE AS A SVMRm TN TTS OWN RTGMT. 



G . 3 A N S W F P S 

l'.O o PHONrTTC 
2.0 ^+0 
3.0 A+7EP0 
4 '. r 1 
5.0 n TEw 



CKF 



G . 4 ACTTnNS 
I*. a R F : 

2.0 m FiLOn* AT THE OFCtmAL 
3'. oiTRY AGATN. 
4.0 -C: 



SYMBOLS AGATN STARTING WITH • 7FPQ' AnO 
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WE CALL THIS NUMBER SYSTEM DECIMAL NOT BECAUSE IT HAS 'DECIMAL POINTS 1 
BUT BECAUSE BEC24AL COMBS RR6M-A LATIN WORD MEANING TEN^- -THE DECIMAL .. 
SYSTEM HAS A BASE OF — . (DIGITS ARE THE PREFERRED RESPONSE) 



10 
-CORRECT- 

THE 'BASE' OF A NUMBER SYSTEM IS DEFINED AS THE TOTAL OF 

DI FFERENT ^ -—^^--^-USEB-Bf-gHAT NUMBER SYSTEM, - 



number eyn f bolBTRUE 

NOTICE THAT ALTHOUGH 9 IS THE HIGHEST ELEMENTARY NUMBER IN THE EECIMAL 

•-SYSTEMS-THERE -ARE ACTUALLY i TSH t DIFFERENT SSffiOLS SINCE WE HJST 

ALWAYS INCLUDE AS A SYMBOL IN ITS OWN RIGHT. 

' 
FINE 
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APPENDIX III 



PHASE I AND II DATA ANALYSIS, USAF APTITUDE TEST SCORES 
AND SAMPLE DATA COLLECT ION FORMS 

The detailed analysis performed on the data collected during the Phase I and II 
validation activity is presented. In addition, the USAF aptitude test scores 
on all participating trainees is provided. Finally, samples of forms provided 
to the trainees for recording pertinent data is included. 



4 
5 
6 
7 
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TABLE 
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TABLE 
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TABLE 
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TABLE 13 
TABLE 
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14 - 
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Missed Test Items — Phase II Trainees 133 

Sample of Item Analysis and Disposition—Phase II 134 

Response Latencies --Phase II 139 

Samples of Forms Used in Phase I Validation Activity 140 

Samples of Forms Used in Phase II Validation Activity 146 
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TABLE 4 - USAF Aptitude Test Scores 



(Sheet 1 of 2) 



Phase I 



TRAINEE 
DESIGNATOR EDPT GENERAL ADMINISTRATIVE MECHANICAL ELECTRONIC AFQT 



68 



lh 



05 



57 



6k 



60 



60 



80 



75 



75 



80 



05 



70 
65 
80 

95 
85 
95 



6o 


70 


89 


80 


75 


7^ 


6o 


75 


78 


6o 


80 


63 


6o 


65 


7h 


90 


85 


9k 



Comments 

PHASE I Validation for the Computer Operator's Training Module was conducted at 
Sheppard AFB from 4 March through 24 March 1969. 

Six airmen served as trainees for this GIVE (Group - Individual Validation 
Environment) phase. 
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TABLE 4 - USAF Aptitude Test Scores (Sheet 2 of 2) 

Phase II 



TRAINEE 



DESIGNATOR 


EDPT 


GENERAL 


ADMINISTRATOR ^ 
95 


1ECHANICA 


L ELECTRONIC 
95 


AFOJ 


1 


71 


95 


90 


72 


2 


73 


70 


95 


50 


70 


78 


3 


72 


90 


95 


80 


95 


52 


4 


75 


95 


90 


90 


95 


76 


5 


77 


90 


95 


75 


90 


81 


6 


83 


70 


85 


35 


60 


91 


7 


73 


95 


95 


85 


95 


70 


8 


72 


95 


90 


95 


95 


93 


9 


75 


85 


95 


25 


60 


95 


10 


85 


85 


85 


65 


90 


91 


11 


72 


75 


70 


50 


70 


82 


12 


74 


95 


85 


90 


95 


98 



Comments 



Phase II Validation for the Computer Operator's Training Module was conducted at 
Sheppard AFB from 28 April through 19 May 1969. 

Twelve Airmen served as the trainees for this field test in a simulated classroom 
environment. 
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TABLE 5 



Lesson Execution Effective Time - Phase I 



(Sheet 1 of 2) 



BODY + 
REVIEW 



TEST 



SUB 
TOTALS 



LSN 


SHORT 


LONG 


M 


SHORT 


KiNG 


M 


1 


1:30 


2:03 


1:*7 


*1:16 


*1:22 


1:19* 


2 


2:10 


3:30 


2:3* 


:*7 


1:03 




55** 


3 


1:10 


1:53 


1:31 


1:05 


1:09 


1: 


07** 


J* 


:*7 


1:36 


1:12 


:*5 


1:04 




52 


5 


1:17 


3:06 


1:53 


:22 


1:02 




46 


6 


:17 


:53 


:38 


:16 


:30 




23 


7 


1:18 


2:40 


1:*5 


:*3 


1:13 


1: 


01 


8 


1:28 


2:51 


2:05 


:52 


1:35 


1: 


11 


9 


:59 


1:08 


1:04 


:13 


1:04 




36 


10-1 


1:41 


2:35 


2:03 


:29 


1:33 


1 


05 


10-2 


:23 


:37 


:31 


:04 


:37 




14 


11 


1:00 


2:13 


1:53 


:16 


1:35 


1 


00 


12-1 


:31 


1:36 


:52 


:10 


:23 




15 


12-2 


1:29 


2:23 


1:5* 


:44 


2:59 


1 


26 


13-1 


1:14 


2:07 


1:50 


:20 


:33 




3* 


13-2 


1:06 


1:47 


1:25 


= 3* 


1:15 




46 


13-3 


1:20 


2:02 


1:1*3 


:15 


:21 




18 


13-* 


1:46 


2:56 


2:05 


:1k 


1:05 




29 


.13-5 


1:5* 


2:14 


2:02 


:10 


:*3 




:26 




23:28 


40:10 


30:47 


9:35 


21:06 


FT 


^ 



SHORT 


LONG 


M 


2:49 


3:22 


3:06 


3:10 


4:25 


3:29 


2:17 


3:00 


2:38 


1:32 


2:23 


2:04 


2:01 


3:52 


2:39 


:42 


1:20 


1:01 


2:22 


3:41 


2:46 


2:20 


3:*6 


3:16 


1:21 


2:03 


1:40 


2:01 


3:22 


3:08 


:3* 


1:09 


:*5 


2:03 


3:50 


2:53 


:*3 


1:46 


1:07 


2:35 


4:45 


3:20 


1:47 


2:47 


2:24 


1:40 


2:29 


2:11 


1:35 


2:22 


2:01 


2:00 


4:01 


2:3* 


2:02 


2:45 


2:28 


35:3* 


57:08 


45:30 



* Guesstimated, based upon limited data 
** Limited sample 

1. Lessons 10 and 12 were separated into 10-1, 10-2 and 12-1 and 12-2 due 
to the 300 frame limit per lesson imposed by the CDTS. This limit also 
caused lesson 13 to be separated into five sections: 13-1, 13-2, 13-3, 
13-4, 13-5. 

2. BODY AND REVIEW 

Short = The least amount of time spent by a trainee 
Long = The largest amount of time spent by a trainee 
M = Mean lesson time expended 

TEST - The same type of information as above, only pertaining to the 
test portion of the lesson (including any needed remediation 
forced by the lesson) . 

SUBTOTALS - Short and long are trainee totals and do not reflect the 
modular extremes previously mentioned. Note that in most 
cases the short and long columns under the body and review 
and test when added together will not equal the short/long 
subtotals. The mean subtotals is obtained by adding the 
body/review and test means. 
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TABLE 5 



Lesson Execution Effective Time - Phase I 



(Sheet 2 of 2) 



DERIVED 
FACTORS 



TOTALS 



BREAKS 




TERMINAL 




. M 




SHORT 


1 LONG 


:35 


:23 


k:Ok 


3*7 


1^:20 




ko 






:26 




k:35 




U:16 


5:31 




30 






19 




3:27 




3:06 


3*9 




25 






15 




2:>* 




2:12 


3:03 




30 






19 




3:28 




2:50 


k:kl 




10 






08 




1:19 




1:00 


1:38 




:35 






20 




3*1 




3:17 


J+.-36 




ko 






2k 




>+:20 




3:2U 


^:50 




20 






12 




2:12 




1:53 


2:35 




■35 






23 




1^:06 




2:59 


It-: 20 




10 






06 




1:01 




:50 


1:25 




35 






21 




3*9 




2:59 


k : kb 




•15 






08 




1:30 




1:06 


2:09 




ko 






2k 




k:2k 




3:39 


5*9 




30 






18 




3:12 




2:35 


3:35 




25 






16 




2:52 




2:21 


3:10 




25 






15 




2*1 




2:15 


3:02 




:30 






19 




3:23 




2*9 


k-.'jO 




:30 






18 




3:16, 




2:50 


3:33 


9:00 


5' 


3k 


.6o*(A 


50:08 


7.1*2 



COMMENTS 



DERIVED FACTORS - 

Breaks - Based upon a factor which allows one (1) ten 
minute break per hour. 

Terminal - Mean amounts of terminal down time encountered 
based upon 7.2 minutes lost per hour. 

TOTALS - The subtotals are added to the derived factors. 
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TABLE 6 - Lesson Execution By Trainees - Phase I 



TRAINEE 


Phase 1 2 3 U 


5 


6 


7 8 


9 


10-1 


10-2 


11 


12-1 


12-2 


13-11 


13-12 


13-21 


13-22 


13-23 


1 
(4l : 24) 


P 
B 

R 
T 


1:39 3:30 1:49 :47 
:2k 

(1^2) Ll55) 1i2SL jiS 

3:22 4:25 2:58 1:32 


1:28 
2:01 


:17 

to 


1:18 1:28 

1:06 :52 
2:24 2:20 


1:08 
1:21 


2:35 
3:04 


:31 

:11 
-.42 


2:01 

:16 
2:17 


1:36 


1:51 

:44 
2:35 


I'M 

-tffi 

2:10 


1:14 

1:55 


1:33 

1:48 


1:46 
2:00 


1:52 
2:02 


2 
(47:02) 


P 

B 

F 
T 


1:42 2:15 1:53 1:21 1:17 :26 

:15 :11 :10 :0tJ 
(1:19) 1:03 (1:07) :4T :51 :23 
ItlS 3:29 3:00 T?fS 2:16 :4<? 


1:32 1:59 

r07 
1:08 1:35 
2tW JTF 


:59 

1:04 
2:03 


1:5^ 

:02 
1:22 

3o5 


:30 
:04 

~7$ 


2:00 

1:09 
3:09 


:?1 1:46 2:01 
104 2~-42 2^44 


1:42 
2:27 


2:02 

:20 
2:22 


2:09 

:14 
2:23 


1:54 
2J37 


3 
(45:49) 


P 

B 
R 
T 


:39 
1:35 2:10 1:38 1:05 

(109) Ii55j ligl .Ly 
2754 3744 2745 1T58 


1:44 

1:02 
2JZ 


:16 


1:36 2:51 
2:49 3:46 


1:07 

:28 
1:35 


2:11 
2M 


•12 

~Fl2 


2:01 
2:55 


:46 
:18 

rtoT 


2:23 

1:04 
3:27 


2:07 

:20 
2:27 


1:24 
2:02 


1:58 

:20 

2715 


2:14 

:24 
273^ 


2:14 
2~-45 


(44.-15) 


P 

B 
R 
T 


1:17 2:27 1:1k 1:18 

:22 
(1:19) -M (1:07) 1:0k 
2758 JlH" 2:21 2:22 


1:20 

1:00 
2:20 


:20 
1:20 


1:36 2:15 

:5k 1:16 
2:30 3:31 


1:02 

:21 
1:23 


2:12 

1:10 
3:22 


:32 
1:09 


1:08 
2:03 


:31 
:12 

1*5 


1:46 1:14 1:06 
2:59 :33 'M 

4745 TTvf i74o 


1:37 
1:52 


1:48 

:27 
2:15 


2:03 
2740 


5 
(45:51) 


P 

B 


1:30 2:39 1:10 1:36 


2:13 


:53 


1:39 2:27 


1:05 


1:41 


:37 


2:13 
•02 


:32 


2:07 


2:03 


1:14 


1:48 


1:58 


1:58 




R 
T 


(102) ii55) i^L -41 
2749 3T3V 2:17 2:23 


:22 

2:35 


rtff 


:43 1:09 -.39 
2:22 3T30 TsW 


2:39 


4i 


1^5 
3:50 


:1k 

155 


1:27 


:2k 
2757 


1:15 
272"9 


:21 
2~HT 


:26 

2724" 


:13 
27TI 


6 
(46:54) 


P 

B 
R 
T 


1:36 2:15 1:20 :53 
:23 

(1112) iiJ55) ii£5 _l2i 
3:18 3:10 2:25 1:51 


2:21 

:45 

(-M) 

3:52 


:33 

:20 
:53 


2:40 1:30 

(1:01) 1:20 
3^ 2:50 


1:05 

rfi 


1:4 5 
2:01 


:23 


1:5k 

1^09 
3:03 


:53 
1-06 


1:29 

1:24 
2:53 


1:1*9 
2^ 


1:47 
2:21 


1:20 

:15 
1:35 


2:56 

1:05 
4"7oi 


2:09 

:24 
2:33 






P ■ Pretest 
B - Body 
R » Review 
T - Test 
() • Mean tiroes based up 


on approximated or 


limit 


ed data 




















Total effec 


tive time for each trainee Is 


listed 


under 


his number 


design 


ator. 
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TABLE 7 



Phase I Remote Terminal Effectiveness 



Days Of Days Of # 
Device Attempted Non-Func- Degra- 
# Use tion dation 



1 


15 


3 


20 


2 


20 


7 


35 


3 


: 20 


8 


1*0 


l* 


16 


1 


63 


5 


16 


4 


25 


6 


19 








7 


19 








8 


11 


3 


27.3 



Daily- 
Mean Daily Mean Time Loss 
Effec- 
tive Time Close % 
Time Out Hang Misc. Totals Loss 



175 



124 



160 



136 



119 



1U2 



136 



263 



1* 


5.U 


• 3 


9-7 


5-3 


5-3 


11.1 


5 


21.1* 


lU.tt 


U.6 


2.3 


1.8 


8.7 


5.2 


5 


5.8 


5-3 


16.1 


10.6 


h.k 


1.5 


3-3 


9-2 


7.2 


k 


1.1 


.5 


5.6 


3-8 


7.2 


3-6 


2.3 


13-1 


8.8 


7.8 


3 





10.8 


3-9 



% 
Terminal 
Effectiveness 



7^.7 



50.2 



5^.8 



83.1 



67. b 



96.2 



91.2 



68.8 



COMMENTS 



A. Percent Degradation 



Days of Non-Function 
Days of Attempted Use 



B. Percent Loss 



Daily Mean Loss Totai 
Daily Mean Effective Time 



C. Percent Terminal 
Effectiveness 



100- (A+B) 



129 



TABLE 8 - Time Expended by Trainees - Phase II 



(Sheet 1 of 2) 



MINUTES 



Dates 
Actual Begin 
End 

Time Expended 
Scheduled Time 
Effective Time 
Down Time 

Computer Operations 

Terminal -Down 

Terminal TO/ 
Close/Ribbon 

OS 

DCH 

Disk 
Other Hardware 
Power Failure 



28 


29 


30 


1 


2 


3 


5 


6 


7 


1 1830 


1825 


1825 


1845 


1937 


0837 


1800 


1830 


1855 


2400 


2400 


2400 


2400 


2400 


1200 


2400 


2400 


2400 


2640 


2680 


2680 


2520 


2104 


1624 


2880 


2640 


2440 


2880 


2880 


2880 


2880 


2880 


1920 


2880 


2880 


2880 


2372 


2147 


1831 


2204 


745 


1558 


2377 


2202 


1805 


508 


733 


1049 


676 


2135 


362 


503 


678 


1075 


240 


200 


200 


360 


776 


296 





240 


440 


39 


54 


360 


18 





21 


420 


258 


305 


149 


255 


105 


122 


39 


45 


83 


116 


234 


80 


104 
120 


104 
40 

240 


144 
32 


1320 






64 


96 



COMMENTS 



Scheduled Time: 6 Hours X 8 Remote Terminals = 2880 Minutes 
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TABLE 8 - Time Expended by Trainees - Phase II 



(Sheet 2 of 2) 



Dates 
Actual Begin 
End 

Time Expended 
Scheduled Time 
Effective Time 
Down Time 



Computer Operations 

Terminal -Down 

Terminal TO/ 
Close/Ribbon 

OS 

DCH 

Disk 
Other Hardware 
Power Failure 



MINUTES 



10 12 



13 



14 15 16 17 



19 



1800 


1843 


0805 


1845 


1848 


1800 


1823 


1820 


0800 


1840 


2400 


2400 


1200 


2400 


2400 


2400 


2400 


2400 


1200 


2400 


2880 


2536 


1880 


2520 


2496 


2880 


2696 


2720 


1920 


2560 


2880 


2880 


1920 


2880 


2880 


2880 


2880 


2880 


1920 


2880 


1718 


1925 


1538 


2041 


2134 


1240 


2406 


1726 


1826 


2445 


1162 


955 


382 


839 


746 


1640 


474 


1154 


94 


435 





344 


40 


360 


384 





184 


160 





320 


597 


440 


240 


315 


29 


28 


10 


46 





98 


117 


91 


102 


164 


253 


108 


280 


412 


94 


61 


40 


80 






80 


64 










408 










1440 




16 
520 




56 



TOTALS 







In Mins . 


% 


Scheduled Time 




51840 


100.0 


Effective Time 




36240 


69.9 


Down Time 




15600 


30.1 


Computer Operations 


4544 


8.8 


Terminal -Down 




3278 


6.3 


Terminal To/Close/Ribbon 


2830 


5.5 


OS 




680 


1.3 


DCH 




272 


.5 


Disk 




504 


1.0 


Other Hardware 




1752 


3.4 


Power Failure 




1840 


3.5 



No time was lost due to: 

• Program Recompilation 

• CDTS Errors 
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TABLE 9 - Criterion Test Scores by Phase II Trainees 



l e s 

6 



SONS 

7 



10 



II 



12 13-1 13-2 



MDW. 



1 


97 


92 


92 


91 


i 

77 


93 


09 


100 


87 


93 


; 96 


93 


<* 


9 k 


93 


. 2 


76 


t58 


95 


91 


06 


79 


93 


59 


96 


06 


95 


06 


96 


96 


69.5 


^ 


97 


100 


95 


95 


95 


93 


93 


93 


87 


93 


95 


9o 


90 


100 


y5 


k 


<* 


97 


92 


09 


95 


100 


o9 


01 


100 


oU 


95 


OH 


96 


92 


9^5 


5 


68 


92 


97 


95 


06 


97 


89 


93 


03 


93 


71 


93 


. 96 


96 


93 


, £ 


01 


73 


o2 


ok 


6k 


OH 


UO 


59 


71 


06 


79 


Ik 


9U 


(62) 


oO 


7 


9U 


89 


95 


95 


91 


93 


93 


01 


07 


00 


95 


95 


96 


92 


93 


6 


07 


02 


07 


100 


OS 


.0^ 


70 


100 


06 


00 


on 


ofl 


ofi 


oh 


oA . 


9 


97 


97 


100 


100 


100 


97 


93 


96 


100 


90 


93 


90 


100 


96 


97 


10 


S* 


56 


67 


09 


91 


07 


70 


Ik 


03 


91 


03 


93 


90 


6b 


67.5 


11 


06 


92 


07 


91 


95 


100 


Ik 


01 


100 


06 


' 93 


90 


96 


92 


? 1 >5 


12 


Ob 


100 


97 


95 


02 


OU 


70 


67 


92 


9b 


00 


06 


06 


98 


99 


MDN* 


<* 


92 


95 


93 


91 


93 


09 


01 


69-5 


93 


9h 


93 


90 


93 


93 



COMMENTS 

A, Medians in rows reflects overall score for each trainee across all lessons, 

B. Medians in columns reflect overall test results achieved by all trainees 
for a specific lesson. 
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TABLE 10 - Missed Test Items - Phase II Trainees 



LESSONS 



CO 



CO 

C 

o 
u 

CO 



£5 



Total 
Items 

4 

i 

2 

3 
U 

5 
6 

T 
» 

9 



1 


2 


3 


U 


5 


6 


7 


a 


9 


10 


11 


12 


13-3 


- 13-2 


Totals 


32 


33 


30 


3« 


22 


30 


27 


27 


2U 


4U 


42 


42 


49 


50 


U9S 


1U 


1H 


22 


1H 


11 


12 


H 





10 


s*5 


23 


21 


37 


31 


25tt 


11 


7 


9 


16 


3 


10 


5 


h 


6 





7 


11 


7 


11 


115 


1 


3 


3 


2 


h 


5 


5 


3 


it 


5 


7 


3 


3 


3 


51 


3 


U 


l 




1 


l 


3 


5 


2 


l 


2 


4 


1 


2 


30 


2 




2 




2 


l 


3 


3 


2 


3 




l 




1 


20 


1 


1 


1 


1 

1 


1 


l 


1 
l 

1 


2 

1 

1 




1 
l 


1 
1 

1 


2 


1 


1 
1 

j 


12 
6 
2 
1 
3 
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TABLE 11 - Sample of Item Analysis and Disposition—Phase II 



Page 



Reference 1: 



Reference 2: 



Reference 3: 



Indicates those criterion test items within each lesson 
that three or more trainees missed and the action taken 
if any, (Items with less than three wrong responses were 
omitted from analysis) 135 

Shows a frame analysis from lesson 7. The items represented 
on this form are indicated as F#132 through F#137. Erroneous 
responses by trainees to these items are indicated 136 

The actual test items (F#132 through F#137) are indicated. . 138 
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Reference 1 



LESSONS 



VD sj sj 
to *-J to 

• 


1— ' I-* 1— ' I— 1 
(jj <jj <jj (jj 

>j <y» u to 




t — * t — » t — » • — • 

Ln 00 0> Ln 
M to VD £> 


to to 
4> U> 


to to 
to to 


t — * l — * i — * i — * i — » ■ — * 

<T» 0> Cn ^ IjJ UJ 
to O -P* *-J Ln to 


LnU^> 


(jj £* .p* vo 


0> Ln 


<jJ Ln £* .p* 


(jj Ln 


U> U> 


vjO <jJ <jJ Ln -P* .p* 


X 






X 


X 


XXX 


X X 


X X 






X X 


X 


X 




X X 


X 




X 


X 


X X 


X 


X X 


X 


XXX 




X 



LESSONS 



LESSONS 



VjO 

I 



No. Missed 
No Change 
Rewrite Frame(s) 
Create Frame(s) 
Alter Test Q 



VD 


00 










-*j 


, 1 — • 1 — • 1 — • 1— ■ 

Ln Ui .p* LO 
LO to Ui *-J 


■ — • l — • 1 — * 1 — * 1 — » 1 — » ■ — » t — » ■ — » ■ — * 1 — * 1 — * 


1 — » ■ — » I — » 

4> .p* (jJ 


■p* 


1— • 
u> 

J— ' 

• 

00 


1— ' 

O 

• 


126 
128 
130.1 


(jj LO f> f> 


UJLn.p*Ln<jj<jj^j.p*O>vj0.p*<jJ 


•P* 4> (jJ 


Ln 


U> 


4> 


VjO VD 0> 




X X 


X 


X X 


XX XXX 


XXX 


X 


X 




X 


X X 


X X X X XX X 


X 


X 


X 


X 


X X 






X 








X 



No. Missed 

No Change 
Rewrite Frame (s) 
Create Frame(s) 
Alter Test Q 





to 




M 






to 


h- • 


o 


l— 1 \-> o 
ro o *^J 

• 

to 


218.9 
219 


VJ0 
ON 
ON 


M 
VD 
•P* 

. 

U> 


U) 

t— • 
VD 

. 


307 
311.5 


(jj to to to 

O VD VD VD 
ON *^J VJO tO 


to to to to J— 1 

1— » 1— ' O O 00 
1— • O VD 00 1— • 


to to to to to to 
00 00 on Ui Ui <-n 

(jJ to (jJ VD **J -P* 


(jj VjO Ul 


*^J VjO 


U> 


Ui 


U) 


•P* o> 


ON <jJ UJ (jJ 


ON Ln VD <jJ <jJ 


f" 00 Ln ^ ^ UJ 






X X 






X X 




X 


X 




X 


XXX 








X 


X X 


X X X X X 


X x 


XXX 


X 


X 


X 




X X 


X 


X X 


X XX X 



No. Missed 
No Change 
Rewrite Frame(s) 
Create Frame(s) 
Alter Test Q 
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Reference 2 



(Sheet 1 of 2) 



en 



en 



Pn 



o 



Q 
O 



in 
en 



H ^ 
CO H 



cn 



en 
cn 



Pn 



55 
O 

CO 
CO 

w 



cn 



Pn 













M 

< 












e 

cd 
u 

a 
u 

o 

CO 
PQ 












o 

O 

M 
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SELECTED TEST QUESTIONS 
Reference 3 

132 What is the programming language in which the programmer uses 
symbolic code and macro instructions? 

A Procedure -oriented language 

B Intermediate language 

C RPG language 

D+ Machine -oriented language 

E Machine language 

133 What converts symbolic code to machine languages? 

A Generator 

B Compiler 

C+ Assembler 

D Translator 

E None of the above 

134 A program is input to the assembler/compiler, 

A+ Symbolic 
B+ Source 

135 The machine language program that is the output of the assembler/ 
compiler is called an program. 

A+ Object 

136 What is the same as an object program? 

A Compiler Input 

B Source Program 

C+ Loadable Application Program 

D Hexadecimal Program 

E None of the above 

137 Pick out the higher-order, user-oriented language which allows one 
to write programs. 

A Intermediate language 

B Mach ine -or iented language 

C Machine language 

D+ Procedure -or iented language 
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TABLE 12 - Response Latencies — Phase II 
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TABLE 13 



Samples of Forms Used in Phase I Validation Activity 



Page 



Reference 1 
Reference 2 
Reference 3 
Reference 4 
Reference 5 



Explanation of CDTS Validation Forms - Phase I 141 

CDTS Time Ordered Log 142 

Trainee Comment Sheet 143 

Trainee Recording Log 144 

Frame Analysis 145 
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Reference 1 

EXPLANATION OF CDTS VALIDATION FORMS- -PHASE I 

CDTS TIME ORDERED LOG - The purpose of this form is for the recording of system 
down time. It is used by the monitors. They note the time problems begin and 
end, and make notations in the appropriate event columns. The three areas are: 

1) Hardware - All problems directly related to the terminal or the computer 

and any of its associated hardware, 

2) Program - An error condition resulting from a flaw in the CDTS program. 

3) Course logic - Does the course do what it logically should? ( Not the 

measuring of how well it teaches.) Errors here would 
be attributed to decision frame inadequacies, faulty 
item sets, incorrect feedback type, incorrect branching, 
and the like. 

TRAINEE COMMENT SHEET - This form is used by the monitors. It is the heart of 
the validation process. The monitor notes the frame # from the lesson printout, 
and makes descriptive comments of anything which may be of use for course mod- 
ification. This would include not only any error conditions encountered and 
audible comments, but also all observed mannerisms. In short, all information 
gathered will be used which might indicate a possible problem for the trainee. 

The time portion located in the upper right hand corner is a back-up to the 
TRAINEE RECORDING LOG. 

TRAINEE RECORDING LOG - The trainee merely enters the times he began and finished 
the four major breakdowns of the course material. He also enters the name of 
each lesson. Should he need more space for entering times for a given lesson, 
he duplicates the lesson name in the column immediately to his right. 

FRAME ANALYSIS - Used by the validator for the recording of all the salient 
points uncovered during: 

1) The GIVE session. 

2) The critique sessions immediately following the lesson proper. 

Course modifications will be done primarily as a result of the information 
recorded on this chart. 
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Reference 3 



COMPUTER OPERATORS TRAINING MODULE PHASE 

TRAINEE COMMENT SHEET TIME BEGAN 



TRAINEE 



TERMINAL 



LESSON 



DATE 



Pretest^ 
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Reference 5 
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TABLE 14 - Samples of Forms Used in Phase II Validation Activity 



Page 



Reference 1 - Explanation of Phase II Validation Forms 147 

Reference 2 • - Trainee Comment Sheet 148 

Reference 3 - Time Ordered Group Down Time Log 149 

Reference 4 - Trainee Attitude Survey 150 
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Reference 1 

EXPLANATION OF PHASE II VALIDATION FORMS 

TRAINEE COMMENT SHEET - This form is used DAILY by trainees during Phase II to 
record several categories of information. 

The trainee enters his name, the remote terminal identification, the name of the 
lesson and the date in the space provided. The time portion refers to the four 
major areas of the course material. The trainee enters the time he begins and 
ends each area. A time is not required if a particular area is omitted. The 
trainee also logs the beginning and end time for each break taken during a par- 
ticular session in the space provided. 

In the terminal down time portion of the form, the trainee COUNTS the number of 
times the remote terminal is timed out either in the transmit or receive mode of 
operation. The number of times the functional system closes the device, thus 
requiring an OPEN, is also tallied. The amount of time lost due to the paper or 
ribbon malfunctioning, and any other problems relating to the remote terminal should 
be noted. 

The remainder of the form is used to record all comments relating to the lesson 
being executed. Any time the trainee feels something is wrong with the lesson, 
the material is not clear or is misleading, or an apparent inserted answer was 
considered incorrect, etc., he writes a number on his printout (starting at 1 
and proceeding in sequential order) . He then enters that reference number and 
documents all pertinent data on this sheet. This provides a cross-reference 
for use by the monitors after the session has ended. 

If more than one sheet is used, the trainee enters the page number in the space 
provided (upper right) on the form. 

TIME ORDERED GROUP DOWN TIME LOG - The purpose of this form is for the recording 
of system down time as opposed to specific problems relating to a lesson or 
remote terminal and is used by the monitors. They note the time problems begin 
and end, and make notations in the appropriate event columns. 
The two areas are: 

1) Hardware/MCP - All problems directly related to the computer hardware 

as well as the Master Control Program (MCP) . 

2) CDTS Program - An error condition resulting from a flaw in the CDTS 

program. 
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Reference 4 
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Lesson Name CO 
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5) UNDERSTAND ABILITY OF MATERIAL 
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Appendix IV 



FORMAL QUALIFICATION TESTING RESULTS 

The printouts generated as part of the Formal Qualification Testing conducted 
16-18 June 1969 are presented. 

Page 

Printouts of "Trainee*' and "Course Designer" Actions 155 

Off- Line/ On- Line Printouts of Test--OFLINE 315 

Sample Trainee Record 337 
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PRINTOUTS OF "TRAINEE" AND "COURSE DESIGNER" ACTIONS 

The printouts generated by the CDTS as the Test Team member executed DEMO01 
and DEMO02 as a "trainee" are contained on the left side of each page. The 
printouts generated by the Test Team member acting as a "course designer" are 
contained on the right side of each page. 

An attempt has been made to relate the "trainee" and "course designer" print- 
outs to reflect the interaction required during the conduct of the Formal 
Qualification Testing. A blank page indicates action was not required by one 
of the Test Team members at that particular position in the test. 
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-TO RESUME PROCESSING, LOG IN 

♦open for e 5753^9169 
ENTER INITIAL COMMAND TO CDTS. 
?get demo01 vsuzukl 
069167 

.CDTS. 
CDTS IS THE COMPUTER DIRECTED TRAINING SUBSYSTEM OF 

THE AIR FORCE PHASE II BASE LEVEL SYSTEM 



WOULD YOU BE INTERESTED IN A BRIEF DESCRIPTION OF THE PURPOSE, 
ORGANIZATION, AND OPERATION OF CDTS, OR SHOULD WE MOVE DIRECTLY TO A 
DETAILED DEMONSTRATION OF ITS FUNCTIONS AND CAPABILITIES? 

(CHOOSE A OR B) 
A PLEASE PRESENT A BASIC DESCRIPTION CF CDTS 

B LET'S MOVE ON TO THE DETAILED DATA 

* 

• 

a 

CDTS IS A GENERAL PURPOSE TRAINING SYSTEM WHICH USES A USER-ORIENTED 
LANGUAGE (SOMETHING LIKE COBOL) TO PERMIT COURSE DESIGNERS To CONSTRUCT 
MATERIAL FOR ANY TRAINING PURPOSE. THIS MATERIAL MAY BE INPUT TO THE 
SYSTEM IN AN ON-LINE MODE FROM A REMOTE TERMINAL, OR CONSTRUCTED FROM 
CARD INPUT TO A BATCH PROCESSING PROGRAM. 

ONCE CONSTRUCTED, LESSON MATERIAL IS SAVED ONTO DISK STORAGE FOR 
FUTURE PRESENTATION. 

TO ACCOMPLISH ITS TRAINING OBJECTIVES, CDTS IS DIVIDED INTO 

FIVE BASIC COMPONENTS: 



1 ) A CONTROL FUNCTION 

2) A LESSON-BUILDING MODE 

3) A LESSON-EXECUTION MODE 

k) AN OFF-LINE LESSON-BUILDING MODE 
5 ) A TRAINEE RECORD PROCESSING PROGRAM 



THE DESIGN OF THE B3500 SYSTEM REQUIRES THAT EACH ON-LINE SYSTEM SUCH 
AS CDTS HAS ONE SEGMENT OF THE PROGRAM THAT PROVIDES THE COMPLETE 
INTERFACE WITH THE MASTER CONTROL PROGRAM (MCP) AND DATA 
COMMUNICATIONS HANDLER (DCH). THIS PART OF CDTS CONTROLS 
THE OPERATION OF THE LESSON-BUILDING AND LESSON EXECUTION MODES, AND 
IS CALLED THE FUNCTION. 

control 

RIGHT - THE CONTROL FUNCTION PROVIDES THE INTERFACE. 
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AS STATED A MOMENT AGO, THE LESSON-BUILDING MODE OF CDTS PERMITS 
AUTHORIZED PERSONNEL TO CONSTRUCT COURSE MATERIAL FOR A VARIETY OF 

TRAINING PURPOSES. SINCE THE MATERIAL DEVELOPED UNDER CDTS MAY HAVE 
TO BE MODIFIED IN TIME, THE LESSON-BUILDING MODE PROVIDES A CAPABILITY 
OF CHANGING A LESSON WITHOUT HAVING TO ENTIRELY RETYPE IT. 



THIS MODIFICATION CAPABILITY IS A SUB/ MODE OF LESSON/BUHDING AND 
WOULD BE CALLED: 



A LESSON-BUHDING 
B LESSON-EDITING 
C LESSON- SAVING 

b 

FINE 

THE LESSON- EXECUTION FUNCTION PERMITS THE PRESENTATION OF COURSE 
MATERIAL TO STUDENTS AT REMOTE TERMINALS, JUST AS THIS DEMONSTRATION 
IS CURRENTLY BEING PRESENTED. 

LESSON- EXECUTION EVALUATES STUDENT RESPONSES TO TEST ITEMS AND PRESENTS 
ADDITIONAL MATERIAL BASED UPON STUDENT PROGRESS. 

TO USE THE THE LESSON-EXECUTION PORTION OF THE SYSTEM, ONE MUST HAVE 
PREVIOUSLY CONSTRUCTED AT LEAST ONE LESSON, THROUGH THE 

LESSON MODE. 

building 

VERY GOOD 

WE HAVE BRIEFLY DISCUSSED EACH OF THE THREE SEGMENTS OF THE ON-LINE 

PORTION OF CDTS. THERE ARE TWO BATCH PROCESSING PROGRAMS WHICH ARE 

USED IN CONJUNCTION WITH THE ON-LINE FUNCTIONS TO PROVIDE A TOTAL 

SYSTEM CAPABILITY. 

ONE BATCH PROCESSING PROGRAM PERMITS AUTHORIZED PERSONNEL TO ACCESS 

THE RECORDS OF TRAINEE OR STUDENT PERFORMANCE THAT ARE COMPILED DURING 

THE EXECUTION OF A LESSON. THIS PROGRAM OUTPUTS REPORTS ON EACH TRAINEE 

AND QUITE NATURALLY IS CALLED THE TRAINEE PROCESSING PROGRAM. 

# 

records 

OK 

A BIT LATER IN THIS DEMONSTRATION WE'LL SEE SOME EXAMPLES OF THE EXACT 

FORMAT AND CONTENT OF THE TRAINEE RECORDS. BUT FIRST LET'S CONSIDER 

THE FIFTH AND LAST OF THE MAJOR FUNCTIONS OF CDTS 
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TYPING EACH LINE OF DATA FOR A LESSON INTO CDTS FROM A REMOTE TERMINAL 
CAN BE A TIME CONSUMING PROCESS. TO BE FREED FROM THIS CHORE, THE 
COURSE DESIGNER MAY MANUSCRIPT HIS LESSON ON KEYPUNCH FORMS. 
THE KEYPUNCHED DECK IS THEN INPUT TO A BATCH PROCESSING PROGRAM WHICH 
CHECKS FOR FORMAT ERRORS, BUILDS THE LESSON ONTO DISK STORAGE, AND 
FINALLY OUTPUTS A LISTING OF THE LESSON CONTENTS, ALONG WITH 
NOTATIONS OF ANY DETECTED ERRORS. 

THIS BATCH PROCESSING METHOD OF LESSON BUILDING ELIMINATES THE 
REQUIREMENT FOR THE "ON-LINE" PORTION OF CDTS TO BE OPERATING, AND IS 
LOGICALLY NAMED LESSON BUILDING. 

A OFF LINE 
B ON LINE 
C KEYPUNCHED 

b 

YOU'VE MISSED THE KEY POINT. THE PROGRAM ELIMINATES THE NEED FOR 

GOING ON-LINE WITH CDTS. LET'S GO BACK AND LOOK AT THE FACT THAT 
TYPING EACH LINE OF DATA FOR A LESSON INTO CDTS FROM A REMOTE TERMINAL 
CAN BE A TIME CONSUMING PROCESS. TO BE FREED FROM THIS CHORE, THE 
COURSE DESIGNER MAY MANUSCRIPT HIS LESSON ON KEYPUNCH FORMS. 
THE KEYPUNCHED DECK IS THEN INPUT TO A BATCH PROCESSING PROGRAM WHICH 

CHECKS FOR FORMAT ERRORS, BUILDS THE LESSON ONTO DISK STORAGE, AND 
FINALLY OUTPUTS A LISTING OF THE LESSON CONTENTS, ALONG WITH 
NOTATIONS OF ANY DETECTED ERRORS. 

THIS BATCH PROCESSING METHOD OF LESSON BUILDING ELIMINATES THE 
REQUIREMENT FOR THE "ON-LINE" PORTION OF CDTS TO BE OPERATING, AND IS 
LOGICALLY NAMED — LESSON BUILDING. 

A OFF LINE 
B ON LINE 
C KEYPUNCHED 

* # 

a 

RIGHT 

THIS CONCLUDES THE INTRODUCTORY MATERIAL ON THE ORGANIZATION OF CDTS. 

YOU SHOULD NOW MAKE A DECISION ON WHETHER TO BE PRESENTED WITH AN 

EXPLANATION OF THE MECHANICS OF USING THE SYSTEM, OR MOVE DIRECTLY TO 

A RATHER DETAILED PRESENTATION ON THE STRUCTURE OF CDTS LESSONS. (TYPE 

IN THE LETTER OF YOUR CHOICE 
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A BRING ON THE NITTY GRITTY OF LESSON STRUCTURE 
B I'D RATHER HAVE AN EXPLANATION OF THE USE OF CDTS 

FINE 

THE GET COMMAND 

*************** 



THE "GET" COMMAND IS THE INITIAL INPUT FROM THE USER TO CDTS To BEGIN 
OR CONTINUE EXECUTION OF A LESSON, OR CONTINUE BUILD ING/EDITING OF AN 
EXISTING LESSON. 

THE FORMAT OF THE GET COMMAND FOR THE STUDENT IS "?GET LESSON LASTNAME" 
WHERE THE NAME OF ANY EXISTING LESSON IS FOLLOWED BY THE STUDENT'S 
LAST NAME AND INITIALS, UP TO A TOTAL OF 16 CHARACTERS. 

CDTS WILL RECOVER FROM AN INVALID "GET" INPUT COMMAND AS FOLLOWS: 

1 ) AN ATTEMPT TO GET A NON-EXISTANT LESSON WILL RESULT IN THE 
OUTPUT OF THE ERROR MESSAGE - "LESSON NOT ON DISK" 

2) AN ATTEMPT TO GET A LESSON, USING AN INCOMPLETE FORMAT, WILL 
RESULT IN THE OUTPUT OF THE ERROR MESSAGE - "INCOMPLETE COMMAND" 

TO VERIFY THIS PROCESSING, TYPE IN "?QUIT" AND THEN CREATE THE ABOVE 
TWO ERROR CONDITIONS. FOLLOWING THE REJECTION OF THESE ATTEMPTS, TYPE 
IN ?GET DEMC01 LASTNAME AND YOU'LL RETURN TO THIS POINT. 

THERE ARE TWO OTHER TYPES OF ERROR CONDITIONS WHICH CAN RESULT FROM A 
GET COMMAND. 

THE FIRST INVOLVES AN ATTEMPT TO GET A SECOND LESSON BEFORE THE USER 
INDICATES TO THE SYSTEM THAT HE WISHES TO "QUIT" EXECUTING THE FIRST. 
SINCE YOU ARE CURRENTLY EXECUTING LESSON "DEMC01", AN ATTEMPT TO GET 
ANOTHER LESSON SUCH AS "000100" WILL BE RESPONDED TO WITH THE MESSAGE 
"LESSON ASSOC 'D". 

(PLEASE TYPE GO AFTER ATTEMPTING TO GET ANOTHER LESSON AND WE WILL 
CONTINUE.) 
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?Get C00100 

INCOMPLETE COMMAND 

?Get Co0100 esther 
LESSON ASSOC 'D 

GO 
THE LAST CDTS REACTION TO AN ILLEGAL GET COMMAND WILL BE DEMONSTRATED 
SHORTLY, WHEN WE CONSIDER THE "CO" INPUT. 

CDTS WILL PERMIT SIMULTANEOUS EXECUTION OF THE SAME LESSON FROM ANY 
NUMBER OF REMOTE DEVICES, AND EACH USER'S POSITION WITHIN A LESSON IS 
MAINTAINED INDEPENDENTLY. TO VERIFY THIS CAPABILITY, THE USER AT THE 

OTHER TERMINAL SHOULD GET LESSON DEMO01 AND EXECUTE BRIEFLY. WHEN THIS 
HAS BEEN DONE TYPE CONTINUE AT THIS DEVICE. YOU WILL FIND THAT YOUR 
PLACE WITHIN THE LESSON HAS NOT BEEN CONFUSED WITH HIS. 



164 



COMPUTER READY - LOG IN 
YOUR DEVICE ID IS 0E. 

FUNCTIONAL SYSTEMS ACTIVE - E . 

*open for e 56109U871 
ENTER INITIAL COMMAND TO CDTS. 
#get d«no01 re 
069167 
ALLOW TRAINEE ACCESS?Y/N 

Y 
ENTER COMMAND 
"h#ex kl0 

3) IF THE LINE BEGINS WITH A LETTER FOLLOWED IMMEDIATELY BY A 

COLON (:), THE PROGRAM ASSUMES IT IS AN ACTION COMMAND AND CHECKS TO 

DETERMINE IF THE LETTER IS A LEGAL ACTION COMMAND. 

IF THE ACTION COMMAND IS LEGAL (F:, C:, R:, B:), PROCESSING OF THE 
LINE CONTINUES. 

IF THE ACTION COMMAND IS ILLEGAL, THE LINE IS IGNORED AND THE PROGRAM 
PROCESSES THE NEXT LINE IN SEQUENCE OR BRANCHES TO THE NEXT FRAME IN 
THE LESSON SEQUENCE IF THE FINAL LINE OF THE GROUP IS REACHED. 

IF A MATCH OCCURS WITH A CORRECT ANSWER INDICATED BY THE PLUS SIGN ( + ) 

TO THE RIGHT OF THE ANSWER TAG IN GROUP 

* 

#save done 
SAVED 
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continue 

THE COURSE DESIGNER MAY HAVE To MAKE CHANGES TO A LESSON WHILE IT IS 
BEING EXECUTED BY A TRAINE. THE USER AT THE OTHER TERMINAL WILL 
RELOG INTO THE SYSTEM AS THE COURSE DESIGNER OF THIS LESSON. WHEN THE 
QUESTION "ALLOW TRAINEE ACCESS YT APPEARS, HE WILL TYPE IN "N." 

THIS ACTION WILL RESULT IN THE OUTPUT OF THE MESSAGE "LESSON ACCESS 
NOW DENIED BY CD" AT THIS AND ANY OTHER TERMINAL WHERE THE LESSON IS 
BEING USED BY A STUDENT. 

TYPE GO WHEN THIS HAS BEEN ACCOMPLISHED. YOU WILL FIND THAT YOUR 

ANSWER IS NOT ACCEPTED. THE NORMAL PRACTICE FOR THE STUDENT WOULD BE 

TO CHECK WITH HIS TRAINING SUPERVISOR. IF THE STUDENT ATTEMPTS TO GET 

THE LESSON AGAIN, YOU WILL SEE THAT HE WILL BE DENIED ACCESS. (WHEN 

THE COURSE DESIGNER IS FINISHED, ACCESS WILL BE AGAIN PERMITTED.) 

TYPE READY WHEN THIS HAS BEEN DEMONSTRATED. 

*. 

go 

LESSON ACCESS NOW DENIED BY CD 

TGET DEMO01 Esther 

061669 

TYPE READY WHEN THIS HAS BEEN DEMONSTRATED. 

• 

Ready 

WE REALLY DO NOT WANT TO DEMONSTRATE THE FULL COURSE DESIGNER 
CAPABILITIES AT THIS TIME. FIRST LET'S CONSIDER THE REST OF THE 
CHARACTERISTICS OF THE GET OOI**AND. 

THE MOST IMPORTANT ASPECT TO THE TRAINEE IS THAT THE PROGRAM PICKS 
HIM UP AT THE POINT IN THE LESSON WHERE HE LAST QUIT. TO DEMONSTRATE 
THIS, TYPE IN ?QUIT BEFORE ANSWERING THE NEXT QUESTION. 

AFTER THE MESSAGE "ENTER INTIAL COMMAND" IS OUTPUT, YOU WILL HAVE TO 
TYPE IN TGBT DEMO01 LASTNAME AND YOU WILL BE PRESENTED WITH THE 
QUESTION AGAIN. 

WHAT IS THE COM4AND THAT IS USED BY A TRAINEE TO ACCESS A LESSON? 
AGO 

B OPEN 
C GET 

?quit 

ENTER INITIAL COMMAND 

?get demo01 esther 
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#get demo01 re 
061669 

ALK)W TRAINEE ACCSSS?Y/N 
. N 
ENTER COMMAND 
#save done 
SAVED 

#get demo01 re 

061669 
ALLOW TRAINEE ACCESS ?Y/N 
Y 
ENTER COMMAND 

#save done 

SAVED 
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WHAT IS THE COMMAND THAT IS USED BY A TRAINEE TO ACCESS A LESSON? 

A CO 

B OPEN 

C GET 

*. 

GET 

CHOOSE ONE OF THE ABOVE LETTERS 
*. 

c 

OK 

A LITTLE LATER WE WILL INPUT THE OJUIT COMMAND WITHIN ANOTHER LESSON, 

AND GET THIS ONE AGAIN, TO VERIFY THAT UDTS CA^BO^KKtfK:?" USSR'S 

W3ITIONS v/ITHLM MORK T}lAN O.Mr; !.,-:,>5iW J*r THE 5A&: 1'Gf;, 

DURING TH.16 NEX? SWOT ION, KHIO>i .'#^LS Wpl'H THF "<X? CV34MAKD, WV W'lU. 
VERIFY OTHER VARIATIONS IN THE USK OP THK "GMT". 

'JCHB "CO" CGNWD IS THE ONLY OTHER INITIAL COMMAND ACCEPTED BY CDTS. 
THIS COMMAND INITIATES LESSON BUILDING OF A NEW LESSON OR PERMITS 
CONTINUATION OF THE CONSTRUCTION OF AN EXISTING LESSON. 

BEFORE WE BEGIN AN EXPLANATION OF THE FORMAT AND PROPER USE OF THE 
"CO" COMMAND, IT MIGHT BE APPROPRIATE TO HAVE A BETTER UNDERSTANDING 
OF THE STRUCTURE OF A CDTS LESSON. 

IF YOU WOULD BE INTERESTED IN THIS BACKGROUND INFORMATION, TYPE IN 
"YES". IF YOU TYPE IN ANY OTHER RESPONSE WE WILL MOVE DIRECTLY TO THE 
DETAILS OF THE "CO". 



yes 

OK, LET'S LOOK AT THE CDTS "FRAME" CONCEPT. 
CDTS LESSON STRUCTURE 

LESSON MATERIAL IS INPUT TO CDTS BY THE COURSE DESIGNER IN "FRAME" 
UNITS. EACH "FRAME" IS FURTHER SEGMENTED INTO "GROUPS" AND THESE GROUPS 
ARE COMPOSED OF INDIVIDUAL LINES OF INFORMATION. A LESSON IS THEREFORE 
A COLLECTION OF LINES WITHIN GROUPS, AND GROUPS WITHIN 

(TYPE IN THE TERM FOR THE LARGEST UNIT OF INFORMATION INPUT To CDTS. ) 
* # 

frames 

RIGHT - THE FRAME IS THE LARGEST UNIT OF A CDTS LESSON. 

TO PROVIDE THE COURSE DESIGNER WITH THE FLEXIBILITY HE NEEDS TO SATISFY 
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VARYING TRAINING REQUIREMENTS, FOUR TYPES OF FRAMES ARE AVAILABLE FOR 
COURSE DESIGNER SELECTION. THESE TYPES ARE REFERED TO AS 
"Q,M,D, AND C 1 WHERE: 
Q= QUESTION FRAME— NORMALLY USED TO PRESENT COURSE CONTENT MATERIAL 

TO INFORM OR REQUIRE A CONSTRUCTED RESPONSE. 

M= MULTIPLE CHOICE-NORMALLY USED TO PRESENT COURSE MATERIAL AND 

ALTERNATIVE ANSWER CHOICES FOR SELECTION. 



D= DECISION FRAME— NORMALLY USED To ESTABLISH CONDITIONAL STATEMENTS 

WHICH ARE EXECUTED DEPENDING UPON RESPONSES TO 
ONE OR MORE FRAMES. 

C= COPY FRAME A LESSON BUILDING AID RATHER THAN A DIFFERENT FRAME 

TYPE, SO THAT PREVIOUSLY CONSTRUCTED FRAMES CAN 
BE COPIED AT A DIFFERENT POINT IN THE LESSON 

TO PRESENT TEXTUAL MATERIAL AND QUESTIONS TO THE STUDENT, AND 
SUBSEQUENTLY EVALUATE STUDENT RESPONSES, THE COURSE DESIGNER WOULD 
THEN SELECT WHICH FRAME TYPES? (TYPE IN A SINGLE LETTER) 

A Q AND C 
B Q AND D 
D M AMD C 
C Q AND M 
E M AND D 
F C AND D 
* 

c 

CORRECT 

WHICH FRAME TYPE WOULD BE USED TO CONTROL THE STUDENT'S PATH THROUGH 

THE LESSON, BASED UPON HIS PREVIOUS RESPONSES? 



decision 
FINE 

NOW THAT YOU UNDERSTAND THE CONCEPT OF THE FRAME, LET'S CONSIDER THE 
ELEMENTS OF FRAMES, WHICH ARE CALLED . 



groups 

GROUPS DIVIDE THE FRAME INTO ONE TO FOUR SUBSETS OF DATA, WHERE EACH 

SUBSET CONTAINS INFORMATION USED FOR THE SAME PURPOSE. 
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THE FIRST GROUP (GROUP 1 ) CONTAINS IDENTIFYING INFORMATION. THE SECOND 
GROUP (GROUP 2) NORMALLY CONTAINS TEXTUAL MATERIAL. GROUP 3 SPECIFIES 
ANSWERS TO BE USED BY THE PROGRAM IN EVALUATING STUDENT RESPONSES. 
THE GROUP U SPECIFIES ACTIONS TO BE TAKEN BY THE PROGRAM, AS A RESULT 
OF THE STUDENT RESPONSES. 

(ALL GROUPS ARE NOT LEGAL WITHIN ALL FRAME TYPES, BUT WE'LL CONSIDER 
SUCH RESTRICTIONS A LITTLE LATER, WHEN WE EXAMINE THE SPECIFICS OF 
BUILDING OF GROUPS, FRAMES AND LESSONS. 

THE CO COMMAND 

************** 



THE 'CO' COMMAND FOLLOWS THE 'GET' COMMAND WHEN THE COURSE DESIGNER 
WISHES TO ADD TO AN EXISTING LESSON. IN THIS CASE THE COURSE DESIGNER 
MERELY INPUTS '#00*, FOLLOWING THE 'ENTER COMMAND' MESSAGE. NO OTHER 
PARAMETERS ARE REQUIRED. 

TO DEMONSTRATE THE CONTINUANCE OF LESSON BUILDING, THE COURSE DESIGNER 
AT THE OTHER TERMINAL WILL 'CO' AFTER GETTING LESSON 'DUMMY', WHICH 
ONLY HAS TWO FRAMES. FOLLOWING THE 'Q,M,D C* PROMPT TO IDENTIFY THE 
FRAME TYPE, THE CD WILL BE INFORMED THAT THE PROGRAM IS READY To BUILD 
FRAME 3. 

THE ACTUAL MECHANICS OF FRAME BUILDING WILL BE DEMONSTRATED SHORTLY, 
SO WE'LL MOVE ON TO THE OTHER ASPECTS OF THE "CO". (TYPE IN "COMMENCE" 
AFTER FRAME 3 HAS BEEN STARTED. ) 
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#get dtnrmy re 

069167 

ALIJDW TRAINEE ACCESS?Y/N 

Y 

ENTER COMMAND 

#C0 

Q,M,D,C 

*. 

q 

FRAME 3.0 LABEL 
*. 

?quit 
ENTER INITIAL COMMAND 
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commence 



TO COMMENCE BUILDING A NEW LESSON, YOU NATURALLY DO NOT HAVE TO FIRST 
EXECUTE THE — COMMAND. 



A CO 
B GET 

a 

RIGHT 

THE FORMAT OF THE "CO" COMMAND TO BEGIN CONSTRUCTION OF A NEW LESSON 
IS "#CO LSSN00 AA," WHERE LSSN00 IS A SIX CHARACTER LESSON NAME, AND 
THE AA IS A TWO CHARACTER COURSE DESIGNER IDENTIFICATION. 
TO DEMONSTRATE THIS, TRE CD ON THE OTHER REMOTE WILL "?QUIT" LESSON 

"DUMMY" AND ATTEMPT TO "CO DUMMY2 XX". THE INDICATION THAT LESSON 
BUILDING HAS STARTED IS THE "Q,M,D,C" CUE. AFTER SELECTING A FRAME TYPE 
HE WILL BE INFORMED THAT FRAME 1 .0 IS READY FOR INPUT. 

AS YOU MIGHT EXPECT, THE COURSE DESIGNER CANNOT ALWAYS COMPLETE THE 
CONSTRUCTION OF A LESSON IN ONE ON-LINE SESSION. AFTER THE CD HAS 
BUILT FRAME 1, TYPE IN "READY FOR TWO" AND WE'LL SEE HOW HE CAN GO 
AWAY AND THEN PICK UP THE CONSTRUCTION OF "DUMMY2" AT FRAME TWO. 



ready for two 

OK, BUT FIRST HE WILL HAVE TO "SAVE" DUMMY2. HE WILL THEN GET THE 
LESSON, "CO", AND BE CUED TO BUILD FRAME TWO. THE PURPOSE OF THIS 
EXERCISE IS TO PROVE THAT YOU CAN "SAVE" A LESSON (THE FULL IMPLI- 
CATIONS OF THE SAVE WILL BE EXPLAINED SHORTLY) AND CONTINUE TO BUILD IT 

IMMEDIATELY THEREAFTER. TYPE "DONE" AFTER HE IS CUED TO START THE 
FRAME. 



* 
done 
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#co dummy2 xx 

Q,M,D,C 

*. 

q 

FRAME 1 .0 LABEL 
* 

A 

G.2 TEXT 

*. 

this i6 frame 1 of dumny2 

*. 

Q,M,D,C 

*. 

#save done 

SAVED 

#get dunmy2 xx 

06169 

ALLOW TRAINE ACCESS ?Y/N 

Y 

ENTER COMMAND 

#co 
Q,M,D,C 

*. 

q 

FRAME 2.0 LABEL 

* 

?qult 

ENTER INITIAL COMMAND 
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NOW WE WILL HAVE A LOOK AT THE WAYS ONE CAN IMPROPERLY USE THE CO. 
ONE WAY WOULD BE TO INPUT THE COMMAND TO BUILD A NEW LESSON, WITHOUT: 
A SPECIFYING A LESSON NAME 
B SPECIFYING A CD ID 

C EITHER OF THE ABOVE 
* # 

c 

RIGHT - OMITTING EITHER PARAMETER IS ILLEGAL 

THE CD AT THE OTHER TERMINAL WILL RECEIVE THE INCOMPLETE COMMAND 
MESSAGE WHEN HE OMITS THIS INFORMATION. HE WILL THEN ATTEMPT TO CO A 
NEW LESSON, BUT USING THE NAME OF AN EXISTING LESSON. 

WHAT MESSAGE WOULD YOU EXPECT AS A RESULT OF THIS ACTION? 

A "LESSON ALREADY EXISTS" 

B "INCOMPLETE COMMAND" 

C "ILLEGAL COMMAND" 
* 

m 

a 

TRUE 

AFTER THE HANDLING OF THESE ACTIONS HAS BEEN VERIFIED, TYPE IN 

"GO". 

* 

• 

go 

THE LAST FUNCTION OF THE CO TO BE VERIFIED IS THE ABILITY TO COMMENCE 

BUILDING A NEW FRAME AFTER HAVING "RESTARTED" AN OLD LESSON WITH THE 

SAME NAME. WE'LL DO THIS SHORTLY, WHEN WE LOOK AT THE ENTIRE AREA OF 
THE RESTART COMMAND. FOR NOW, LET'S MOVE ON AND EXAMINE THE CDTS 
USER OPTIONS. 
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#co lssn 
INCOMPLETE COMMAND 

#co dummy2 re 
LESSON ALREADY EXISTS 



Ead of Day 1 Formal Qualification Testing 
Course Designer 
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CDTS OPTIONS 

************* 

THERE ARE TWO OPTIONS AVAILABLE To THE USER OF CDTS. ONE IS 'GOTO' AND 
THE OTHER IS 'QUIT'. WE WELL CONSIDER GOTO AND THEN ^JIT. 

THE GOTO OPTION PERMITS THE TRAINEE OR COURSE DESIGNER IN A PSEUDO- 
TRAINEE ROLE TO BRANCH TO A SPECIFIED FRAME LABEL WITHIN THE LESSON 

BEING EXECUTED. WHEN INSERTED WITH A LEGAL FRAME LABEL, THE PROGRAM 
BRANCHES UNCONDITIONALLY TO THE FRAME LABEL INDICATED. 



this allows the student to move about a given lesson at his own 
discretion, once he is made aware of the goto option format and the 
accessible frame labels within the lesson. 

the format for this option is: 

?got0 label 

to verify this option as used by a student, you will be required to 
use this command in several different situations. 

the first situation will be to goto the same frame currently being 

EXECUTED. 

THIS FRAME WILL BE PRESENTED AGAIN AFTER YOU INSERT: 
?GOTO F113 

THE NEXT TIME IT PRINTS AND STOPS, TYPE GO. 

* 

Tgoto f113 
THIS FRAME WELL BE PRESENTED AGAIN AFTER YOU INSERT: 

?GCTO F113 

THE NEXT TIME IT PRINTS AND STOPS, TYPE GO. 

* _ 

go 

FINE 

THE ABOVE FRAME SHOULD HAVE PRETTED TWICE 
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TO VERIFY THIS CONDITION, INPUT ?GOTO F113 AGAIN AND WHEN AN *. IS 

PRESENTED, TYPE GO. 
* 

?goto f!13 

THIS FRAME WILL BE PRESENTED AGAIN AFTER YOU INSERT: 

?GOTO F113 

THE NEXT TIME IT PRINTS AND STOPS, TYPE GO. 

* 

go 

FINE 

NOW, LET'S ATTEMPT TO GO TO A NONEXISTENT FRAME LABEL. 

INPUT: 

?GOTO L100 
AFTER THIS HAS BEEN DONE AND THE ERROR MESSAGE 
ILLEGAL BRANCH 

IS OUTPUT, TYPE "?GOTO F117", AND WE WILL CONTINUE. 

* 

. 

i?goto 1100 
'ILLEGAL BRANCH 

ENTER COMMAND 

?goto f!17 
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NOW, HAVE THE PERSON AT THE OTHER CONSOLE ATTEMPT To GOTO A FRAME LABEL 

WITHIN THIS LESSON BEFORE BECOMING ASSOCIATED WITH THE LESSON AS A 
COURSE DESIGNER. 

HAVE THAT PERSON INSERT THE COMMAND: 
?GOTO F118 

THE PROGRAM SHOULD INDICATE: 

ILLEGAL FIRST CCM4AND 

AFTER THIS IS DONE, TYPE GO. 

• 
go 
CK 

NOW HAVE THE PERSON GET THIS LESSON AND GOTO THE FRAME LABELS AS 
INDICATED BELOW: 
?GOTO SIX 

?GOTO F117 
?GOTO F118 
?GOTO F121 
IGNORE THE TEXT OF EACH FRAME UNTIL F121 IS REACHED. 

AFTER GOING TO THE FIRST LABEL AND THE PROGRAM STOPS, THE NEXT LABEL 

SHOULD BE BRANCHED TO USING THE GOTO OPTION. THIS WILL DEMONSTRATE 
THE ABILITY OF THE PROGRAM TO BRANCH TO SEVERAL LABELS WITHIN THE 
LESSON BEING EXECUTED. 

*. 

?quit 

CDTS-OUT 

End of Day 1 Formal Qualification Testing 
Trainee 



182. Page 183 blank 



Page 184 blank 



?goto fll8 

ILLEGAL first command 
#get demo01 9z 

ALLOW TRAINEE ACCESS ?Y/N 

Y 
ENTER COMMAND 

?goto six 
THE DESIGN OF THE B3500 SYSTEM REQUIRES THAT EACH ON-LINE SYSTEM SUCH 

AS CDTS HAS ONE SEGMENT OF THE PROGRAM THAT PROVIDES THE COMPLETE 
INTERFACE WITH THE MASTER CONTROL PROGRAM (MCP) AND DATA 

COMMUNICATIONS HANDLER (DCH). THIS PART OF CDTS CONTROLS 

THE OPERATION OF THE LESSON-BUILDING AND LESSON EXECUTION MODES, AND 

IS CALLED THE FUNCTION. 

+ . 

?goto f117 

NOW, HAVE THE PERSON AT THE OTHER CONSOLE ATTEMPT TO GOTO A FRAME LABEL 

WITHIN THIS LESSON BEFORE BECOMING ASSOCIATED WITH THE LESSON AS A 

COURSE DESIGNER. 

HAVE THAT PERSON INSERT THE COMMAND: 

?GOTO F118 
THE PROGRAM SHOULD INDICATE: 

ILLEGAL FIRST COMMAND 

AFTER THIS IS DONE, TYPE GO. 

?goto fl21 

THIS IS THE FINAL LABELLED FRAME IN THE GOTO SEVERAL LABELS EXERCISE. 

A I'M GLAD 
B TOO BAD 

C LET'S DO IT AGAIN 
* 
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AFTER THIS HAS BEEN DONE AT THE OTHER CONSOLE, DUPLICATE THE ACTIONS 

AS A STUDENT AT THIS CONSOLE. 

THIS IS THE FINAL LABELLED FRAME IN THE GOTO SEVERAL LABELS EXERCISE. 

A I'M GLAD 

B TOO BAD 

C LET'S DO IT AGAIN 

• 

fgoto six 

THE DESIGN OF THE B3500 SYSTEM REQUIRES THAT EACH ON-LINE SYSTEM SUCH 

AS GDTS HAS ONE SEGMENT OF THE PROGRAM THAT PROVIDES THE COMPLETE 

INTERFACE WITH THE MASTER CONTROL PROGRAM (MCP) AND DATA 

COMMUNICATIONS HANDLER (DCH). THIS PART OF CDTS CONTROLS 

THE OPERATION OF THE LESSON-BUILDING AND LESSON EXECUTION MODES, AND 

IS CALLED THE FUNCTION. 

Tgoto f117 

NOW, HAVE THE PERSON AT THE OTHER CONSOLE ATTEMPT TO GOTO A FRAME LABEL 
WITHIN THIS LESSON BEFORE BECOMING ASSOCIATED WITH THE LESSON AS A 
COURSE DESIGNER. 

HAVE THAT PERSON INSERT THE COMMAND: 

?GOTO F118 
THE PROGRAM SHOULD INDICATE: 

ILLEGAL FIRST COMMAND 



AFTER THIS IS DONE, TYPE GO. 

?goto f1l8 

HAVE THAT PERSON INSERT THE COMMAND: 



?GOTO F118 
THE PROGRAM SHOULD INDICATE: 

ILLEGAL FIRST COMMAND 
AFTER THIS IS DONE, TYPE GO. 
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fgoto f121 

THIS IS THE FINAL LABELLED FRAME IN THE GOTO SEVERAL LABELS EXERCISE. 

A I'M GLAD 

B TOO BAD 

C LET'S DO IT AGAIN 

a 

SO AM I 

NOW, HAVE THE PERSON AT THE OTHER CONSOLE ENTER THE COMMAND 

#SAVE DONE 

WHICH DISASSOCIATES THE COURSE DESIGNER FROM THE LESSON. AFTER THE 
MESSAGE: 



SAVED 
IS OUTPUT, HAVE THE PERSON INPUT: 

?GOTO F12U 
AFTER THE PROGRAM OUTPUTS THE MESSAGE: 

ILLEGAL FIRST COMMAND 

TYPE GO TO CONTINUE. 

* 
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#save done 
SAVED 



?goto f[2h 
ILLEGAL FIPST COMMAND 
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go 

FINE 

THE PROGRAM REQUIRES THAT THE USER (COURSE DESIGNER OR STUDENT) 

HAVE A LESSON ASSOCIATED BEFORE THE GOTO OPTION IS PERMISSIBLE. 

NOW, LET'S CONSIDER THE OTHER OPTION 'QUIT'. 

THE QUIT OPTION PERMITS THE USER (STUDENT OR COURSE DESIGNER) TO 
TERMINATE THE LESSON CURRENTLY BEING EXECUTED AND INSERT ANOTHER 
COMMAND EITHER TO CDTS OR THE MCP. 

THE STUDENT NORMALLY USES THE QJIT OPTION PRIOR TO COMPLETING A 
LESSON SO THAT WHEN HE 'GETS' THE LESSON AGAIN, HE WILL BE RETURNED 
TO THE SAME POSITON WITHIN THE LESSON PRIOR TO ENTERING THE 
QUIT OPTION. 

THE COURSE DESIGNER MAY USE THE QUIT OPTION IF HE HAS BEEN EXECUTING 
THE LESSON AS A PSEUDO-TRAINEE FOR QUALITY CONTROL PURPOSES AND HAS NOT 
MODIFIED THE LESSON MATERIAL. 

THE FORMAT FOR THIS OPTION IS: 
?QUIT 

FOLLOW THESE STEPS TO VERIFY THIS OPTION: 

FIRST, INSERT ?QUIT 
THE PROGRAM WILL INDICATE THE OPTION HAS BEEN ACCEPTED By OUTPUTTINO: 

ENTER INITIAL COM4AND 

THIS MESSAGE INDICATES YOU HAVE BEEN DISASSOCIATED FROM THIS LESSON 
AND THE PROGRAM IS WAITING FOR THE NEXT COM4AND 

INSERT ?QUIT AGAIN AND THE PROGRAM WILL OUTPUT THE MESSAGE: 

ILLEGAL FIRST COMMAND 

WHICH INDICATES THAT A USER MUST HAVE A LESSON ASSOCIATED BEFORE IT IS 
LEGAL TO QUIT THE LESSON. 



FINALLY, USING THE GET COM4AND, REQUEST THIS LESSON AND YOU SHOULD 
RETURN TO THE POSITION IN THIS DEMONSTRATION WHERE YOU LEFT OFF. 
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j THE SEQUENCE WILL BE AS FOLLOWS: 

1 . ?QUIT 

2. ?QUIT 

3. ?GET EEMO01 (LAST NAME) 
TYPE ?QUIT WHEN YOU RECEIVE THE NEXT *. 

WHEN YOU SEE THIS LINE AGAIN, TYPE CONTINUE. 

* ?quit 

ENTER INITIAL COMdAND 

* ?quit 

ILLEGAL FIRST COMMAND 
?get demo01 salvage 

061769 

WHEN YOU SEE THIS LINE AGAIN, TYPE CONTINUE. 

• 
continue 
FINE. 

THE FINAL TEST OF THIS OPTION WILL REQUIRE THAT THE USER AT THE OTHER 
CONSOLE GET THIS LESSON AS A COURSE DESIGNER AND THEN INSERT THE 
QUIT OPTION. 



THE PROGRAM WILL OUTPUT THE MESSAGE: 

ENTER INITIAL COM4AND 
WHICH IS THE SAME MESSAGE OUTPUT TO A STUDENT USER. 

THIS COMPLETES THE GENERAL DEMONSTRATION OF THE OPTIONS AVAILABLE TO A 

USER OF THE CDTS. THE TWO OPTIONS ARE Q^IT AND — 

* 

• 

goto 

VERY GOOD, YOU REMEMBERED. 

OK, NOW THAT WE HAVE CONSIDERED SOME OF THE BASIC COMMANDS OF CDTS, 

LET'S DIG INTO THE CONCEPTS OF THE LESSON BUILDING MODE, THERE ARE 

OTHER COMMANDS WITHIN THE SPECTRUM OF CDTS CAPABILITIES, BUT WE WILL 

DELVE INTO THEM AT A MORE APPROPRIATE TIME. 
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#get demo01 9z 

061769 

ALLOW TRAINEE ACCESS ?Y/N 

Y 
ENTER COMMAND 

?quit 
ENTER INITIAL COMMAND 
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LESSON BUILDING 

THE LESSON BUILD INO MODE PERMITS AUTHORIZED PERSONNEL (COURSE 
DESIGNERS) TO CONSTRUCT AND MODIFY LESSON MATERIAL FOR A VARIETY OF 
TRAINING PURPOSES. THE CD MAY cMER LESSON CONTENT, SPECIFY ANSWERS, 
AND INDICATE ACTIONS TO BE TAKEN (IN THE LESSON EXECUTION MODE) AS A 
RESULT OF STUDENT RESPONSES. IT ALSO ALLOWS THE CD TO EDIT (ADD, 
DELETE, OR MODIFY) ANY PORTION OF A LESSON. 

AS MENTIONED PREVIOUSLY, A LESSON IS COMPOSED OF FRAMES WHICH IN TURN 
ARE MADE UP OF GROUPS CONTAINING INDIVIDUAL LINES OF INFORMATION. THE 

FIRST GROUP WE WILL CONSIDER IS THE CONSTRUCTION AND VERIFICATION OF 
GROUP 1. 



THIS GROUP IS THE FIRST LOGICAL SUBSET OF DATA WITHIN THE LESSON FRAME. 

IT IS USED BY THE CD TO SELECT THE TYPE OF FRAME TO BE CONSTRUCTED, 
AND TO LABEL IT IF HE SO DESIRES. THE THIRD PURPOSE OF GROUP 1 IS TO 
OPTIONALLY FLAG THE FRAME AS ONE TO BE USED BY A SUBSEQUENT DECISION 
FRAME. 

VERIFICATION OF THE CONSTRUCTION OF GROUP 1 OF A FRAME WILL BE PERFORM- 
ED BY THE PERSON AT THE OTHER CONSOLE ACTING AS A COURSE DESIGNER. 
THIS PERSON WILL CONSTRUCT SEVERAL FRAMES FOLLOWING A SCRIPT 1UICH 
IS DESIGNED TO DEMONSTRATE THE LEGAL AND IT.TEQAL PARAMETERS OF GROUP 1 
CONSTRUCTION. 



TO START ~R COMMENCE BUILDING A LESSON THE CD MUST USE THE 
COMMAND. 

CO 

EXCELLENT. 

THE CD WILL INPUT: 



iCO LB1 CD 

AND THE PROGRAM WILL OUTPUT THE CUE INDICATING THE TYPES OF LEGAL 
FRAMES AVAILABLE. THESE ARE: 



Q - QUESTION 

M - MULTIPLE-CHOICE 

D - DECISION 

C - COPY AN EXISTING FRAME 
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THE CD WILL BUILD 33VERAL FRAMES USING EACH OF THE LEGAL FRAME 
TYPES AT LEAST TWICE. CERTAIN FRAMES WILL BE LABELLED, SOME WILL BE 

LABELLED AND FLAGGED (FOR USE BY A SUBSEQUENT DECISION FRAME), WHILE 
OTHERS WILL BE DEVOID OF LABELS OR FLAGS. 

FOR EACH LEGAL FRAME TYPE INPUT AND ACCEPTED, THE PROGRAM WILL 

INDICATE: 

FRAME XXXX LABEL 

CDTS WILL AUTOMATICALLY NUMBER THE FRAMES SEQUENTIALLY STARTING 
WITH 1.0 



AT FRAME 2.0, THE CD WILL INSERT A DUPLICATE LABEL AND THE PROGRAM 
WILL INDICATE THAT FRAME 1 .0 IS ALREADY USING THE LABEL. 

TYPE GO AFTER THIS ACTION IS COMPLETED. 

• 

So 

OK 

THE CD WILL BUILD AT LEAST TWO FRAMES WHICH WILL NOT BE LABELLED. THIS 

IS DONE BY USING THE GROUP EXIT INDICATOR IN LIEU OF INSERTING A LABEL. 

THE PROGRAM WILL OUTPUT THE CUE: 

G.2 TEXT 
FOR QUESTION OR MULTIPLE- CHOICE FRAMES, AND 

G.2 CONDITIONS 
FOR DECISION FRAMES. 



AFTER THIS HAS BEEN COMPLETED, TYPE FINE. 

* 

fine 

FINE IS FINE. 
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#co lbl cd 
Q,M,D,C 

*. 

q 

FRAME 1 .0 LABEL 

*. 

f100 

G.2 TEXT 

*. 
* 

Q,M,D,C 

*. 

ql 

FRAME 2.0 LABEL 
* # 

f100 

FRAME 1 .0 IS USING THAT LABEL. 
FRAME 2.0 LABEL 
*. 
f002 

G.2 TEXT 
*. 

Q,M,D,C 

*. 

ml 

FRAME 3.0 LABEL 

A 

G.2 TEXT 

*. 

t 
Q,M,D,C 

*• 

m 

FRAME b.0 LABEL 
* 

A 

G.2 TEXT 
*• 

copy roe 
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NOW THE CD WILL ATTEMPT TO INSERT TWO LABELS WHICH SHOULD BE 
REJECTED AS ILLEGAL. THE PROGRAM WILL OUTPUT: 

ILLEGAL FRAME LABEL 

AND THEN ALLOW THE CD TO INSERT A LEGAL LABEL IF DESIRED. 

AT FRAME 7.0, THE CD WILL ATTEMPT TO INPUT AN ILLEGAL FRAME TYPE. 
THE PROGRAM WILL REJECT THIS ATTEMPT AND OUTPUT: 

ILLEGAL FRAME TYPE - ONLY v^/M/D/C CAN BE ENTERED 

AFTER THIS OCCURS THE SECOND TIME, TYPE CONTINUE. 

continue 
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Q,M,D,C 

*. 

d 

FRAME 5.0 LABEL 

ILLEGAL FRAME LABEL 
FRAME 5.0 LABEL 
. 
f 1 23U56 

ILLEGAL FRAME LABEL 
FRAME 5.0 LABEL 

f005 

G.2 CONDITIONS 

*. 
$ 

Q,M,D,C 
*. 
d 
FRAME 6.0 LABEL 

A 

G.2 CONDITIONS 

*. 

f :copy me 

*. 

$ 

Q,M,D,C 

*. 

a 

ILLEGAL FRAME TYPE - ONLY q/M/d/C CAN BE INSERTED 

Q,M,D,C 

*. 

c k 

Q,M,D,C 

*. 

x 

ILLEGAL FRAME TYPE - ONLY fy M/b/C CAN BE INSERTED 
Q,M,D,C 
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LET'S DO 

the cd will also attempt to insert the frame exit indicator and group 
exit indicator prior to entering a legal frame type. the program 
will indicate: 

illegal Frame type 

A LEGAL FRAME TYPE THE CD COULD ENTER WOULD BE: 
(TYPE A LETTER ONLY) 

q 

VERY GOOD. 

THE MAXIMUM NUMBER OF LABELS ALLOWED IN A LESSON IS k9. THE VERIFICA- 
TION THAT A 50TH LEGAL FRAME LABEL CANNOT BE INSERTED WILL BE DONE 
LATER. ALSO, THE USE AND VERIFICATION OF THE DECISION FRAME INDICATOR 
WILL BE ACCOMPLISHED DURING LESSON EXECUTION. 

WHEN THE CD HAS COMPLETED THE GROUP 1 CONSTRUCTION AND VERIFICATION, 
TYPE GO 



go 

FINE 

THE NEXT GROUP v« WILL CONSIDER IS GROUP 2. AS EXPECTED, THIS GROUP 

IS THE SECOND LOGICAL SUBSET OF DATA WITHIN THE LESSON FRAME. IT IS 

USED BY THE COURSE DESIGNER TO INSERT TEXTUAL MATERIAL TO BE PRESENTED 

TO THE TRAINEE WITHIN ^JESTION OR MULTIPLE- CHOICE FRAMES, OR TO SPECIFY 

THE CONDITION TO BE EXAMINED WITHIN A DECISION FRAME. 

AS WITH GROUP 1 , THE PERSON AT THE OTHER CONSOLE WILL ACT AS A COURSE 
DESIGNER AND CONSTRUCT SEVERAL FRAMES ACCORDING TO A SCRIPT CONCERNED 
SPECIFICALLY WITH GROUP 2 VERIFICATION. 

THE FIRST GROUP Vfi DEMONSTRATED WAS: 
A k 
B 2 
C 1 
D 3 

* 

c 

VERY GOOD, YOU WERE AWAKE. 

TO START OUT, THE CD WILL REQUEST THE PREVIOUS LESSON BY INPUTING THE 
COMMAND: 

LBi CD 
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c 6 

Q,M,D,C 
*. 
$ 

ILLEGAL FRAME TYPE - ONLY Q/M/d/C CAN BE INSERTED 
Q,M,D,C 
*. 

A 

ILLEGAL FRAME TYPE - ONLY Q/M/b/C CAN BE INSERTED 

Q,M,D,C 
*. 
m 
FRAME 9.0 LABEL 

*• 

A 

G.2 TEXT 

*. 

$ 

Q,M,D,C 

*. 

#save done 

SAVED 
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CO 

WRONG, YOU MUST 'GET' AN EXISTING LESSON BEFORE YOU CAN 'CO' 

(CONTINUE TO BUILD) A LESSON. 
THE CD MUST OF COURSE SUCCESSFULLY COMPLETE THE GROUP 1 INPUT 
REQUIREMENTS FOR EACH ATTEMPT TO EITHER LEGALLY OR ILLEGALLY INPUT 
GROUP 2 MATERIAL. 

AFTER 'GETTING' THE LESSON, THE CD WILL CONTINUE TO BUILD THE LESSON 
THE FIRST VERIFICATION WILL BE TO EXIT A GROUP 2 PRIOR TO INSERTING 
ANY DATA. 



WHAT IS THE GROUP EXIT INDICATOR? 

♦ 

THE PROGRAM WILL OUTPUT THE CUE FOR GROUP 3 

G.3 ANSWERS 

IF THE FRAME IS A 'Q' OR 'M' FRAME. FOR A 'D' FRAME, THE PROGRAM 
OUTPUTS THE CUE FOR FRAME SELECTION: 

Q,M,D,C 

AFTER THIS OCCURS TYPE GO. 

go 

FINE. 

NEXT, THE CD WILL ATTEMPT TO START AN ILLEGAL DECISION STATEMENT WITHIN 

A DECISION FRAME. THIS WILL BE ATTEMPTED TWICE BY THE CD. FOR EACH 
ATTEMPT THE PROGRAM WILL REJECT THE ENTRY AND OUTPUT 



REJECTED. ALL DECISION STATEMENTS MUST BEGIN WITH IF, AND, END, 
OR, ELSE, F:, B:, OR #: 

AND ALLOW THE CD TO CORRECT THE ENTRY. THE PROGRAM DOES NOT CHECK THE 
ENTIRE DECISION STATEMENT FOR LEGALITY AT THIS TIME. THIS OCCURS 

DURING LESSON EXECUTION. ONLY THE INITIAL WORD OF EACH LINE OF INPUT 
IS CHECKED FOR LEGALITY. 



AS WITH ALL FRAMES, THE PROGRAM STARTS THE PROCESSING AT THE 

TOP AND PROCEEDS LEFT TO RIGHT, TOP TO BOTTOM A SINGLE LINE AT A TIME. 

AFTER THIS IS COMPLETED TYPE 00. 



202 



#get lb1 cd 
061769 
ALLOW TRAINEE ACCESS?Y/N 
Y 

ENTER COMMAND 
#co 

Q,M,D,C 
*. 

q 

FRAME 10.0 LABEL 

gp2 

G.2 TEXT 

*. 

A 

G.3 ANSWERS 
*. 

$ 
Q,M,D,C 

*. 

d 

FRAME 1 1 .0 LABEL 

A 

G.2 CONDITIONS 

*. 
of right 8 b:end 

REJECTED. ALL DECISION STATEMENTS MUST BEGIN WITH IF, AND, OR, END, F:, B:, ELSE OR ? 
* 

c: 

REJECTED. ALL DECISION STATEMENTS MJST BEGIN WITH IF, AND, OR, END, F:, B:, ELSE OR #: 

* 

A 

Q,M,D,C 
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go 

FINE. 

THE CD WILL BUILD A FRAME AND INPUT THE FRAME EXIT INDICATOR PRIOR TO 

ENTERING ANY DATA IN GROUP 2. THE PROGRAM WILL OUTPUT THE CUE FOR THE 

SELECTION OF THE NEXT FRAME. 

WHAT IS THE FRAME EXIT INDICATOR? 
(TYPE THE CHARACTER) 

* 

A 
FALSE 

THE CORRECT ANSWER IS $ 
AFTER THE PROGRAM HAS OUTPUT THE FRAME CUE — Q,M,D,C 



TYPE GO 

go 

FINE. 

THE NUMBER OF CHARACTERS ALLOWED PER FRAME IS k00. THIS DOES NOT MEAN 
THAT THE CD CAN INPUT U00 CHARACTERS SINCE THE PROGRAM MUST USE A SUB- 
SET OF THIS TOTAL FOR THE FRAME NUMBER, LABEL (IF INSERTED), GROUP 
CUES (I.E. G.2 TEXT, ETC.) AND NUMBER OF CHARACTERS ENTERED IN EACH 
LINE. 

THIS LEAVES 400-X FOR USE BY THE CD. A GOOD RULE OF THUMB IS: AFTER 
k FULL LINES OF TEXT (80 CHARACTERS EACH) CREATE ANOTHER FRAME. 

THE CD WILL ILLUSTRATE WHAT HAPPENS ON-LINE IF THIS U00 CHARACTER PER 
FRAME CAPACITY IS REACHED. ALSO, WITHIN THIS FRAME VARIOUS TYPES OF 
CHARACTERS AND CHARACTER COMBINATIONS WILL BE INPUT TO VERIFY THAT ANY 
CHARACTER NOT RESTRICTED FROM USE BY THE MCP DCH OR BY THE PROGRAM 
CAN BE USED IN A LEGAL MANNER TO CONSTRUCT TEXTUAL MATERIAL. 

AFTER THIS IS COMPLETED, TYPE GROUP 3. 
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m 

FRAME 12.0 LABEL 

A* # 
A 

G # 2 TEXT 

$ 

Q,M,D,C 

*. 

m 

raAME 13.0 LABEL 

A 

G # 2 TEXT 
*. 

this frame will be used to deonstrate what happens when 

*. 
the capacity of U00 charaacters for a single frame is 

*• 
exceeded as well as different combinations of legal char- 

*. 
actersracters: 
*• 
ABCEEFGHIJKLMJOPQFSTUVWXYZ, 

123^567890 

*. 

f:, b:, +,\ /. 

x$? aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa 

*• 
now is the time when all good men acome to the aid of their country 
*. 

aaflaaaa,aaaaaaaaaaaaaaaaaaaaaaaaaaaaa£iaaaaaaaaaflaaaaaflaaaaaaaaanananaaaa.aaaaa 
FRAME CAPACITY REACHED. DELETE LINES TO CONTINUE 

*. 
#save done 
SAVED 
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group 3 

OK, GROUP 3 IS NEXT. 

AS INDICATED IN THE FEEDBACK, WE WILL NOW CONSIDER GROUP 3. THIS IS 

THE THIRD LOGICAL SUBSET OF DATA WITH THE QUESTION AND MULTIPLE-CHOICE 
FRAMES. IT IS USED BY THE COURSE DESIGNER TO IDENTIFY THE CORRECT 
ANSWER TO BE ACCEPTED IN RESPONSE TO GROUP 2 TEXTUAL MATERIAL, AND 
ALSO TO SPECIFY INCORRECT ANSWERS THAT ARE ANTICIPATED TO BE INSERTED 

BY TRAINEES. THE GROUP IS ALSO USED BY THE CD TO TURN THE SERVICE 

FUNCTIONS, ORDER, PHONETIC AND KEYWORD ON AND OFF. 

THE EXECUTION OF GROUP 3 IS DEPENDENT IN PART UPON THE COMPARISON OF 
INSERTED RESPONSES WITH SPECIFIED ANSWERS. THE PROGRAM PROCESSES THE 
INSERTED INFORMATION FROM LEFT TO RIGHT — TOP TO BOTTOM. 

THE INSERTED CONTENT IS EXAMINED TO DETERMINE IF A TAG EXISTS. IF 
YES, THE PROGRAM SETS THE SERVICE FUNCTION INDICATOR (E.G., KEYWORD ON, 
ORDER OFF) PRIOR TO ACCEPTING AND PROCESSING AN INSERTED RESPONSE. 
A SERVICE FUNCTION WITH A TAG OF 1-9 IS EXECUTED IN THE ORDER FOUND 
WITHIN THE FRAME. 



FOR EACH INSERTED RESPONSE, THE PROGRAM EXAMINES THE ANSWER TAGS, 
(A-Z). ALL ANSWER TAGS (EXCEPT TAG 0) ARE EXECUTED IN ORDER FROM TOP 
TO BOTTOM, REGARDLESS OF ANY SEQUENCE ORDERING UNTIL A MATCH (BETWEEN 
THE INSERTED RESPONSE AND THE ANSWER(S) CONSTRUCTED BY THE (CD) IF ANY, 
IS FOUND. NO FURTHER ANSWERS ARE PROCESSED IN THE GROUP AFTER A 
MATCH IS FOUND. 

A NUMERIC TAG CAN BE USED ONLY WITH 

A ANSWERS 

B OPTIONS 

C COMMANDS 

D SERVICE FUNCTIONS 

*, 

d 

RIGHT. 

THE ANSWER(S) WITH A PLUS (+) SIGN PRECEEDING ANY ANSWER TAG 

INDICATES A RESPONSE IS TO BE CONSIDERED CORRECT IF A MATCH OCCURS. 

THE PLUS SIGN IS NOT PRINTED WITH THE ALTERNATIVE- ANSWER IN THE 

MULTIPLE- CHOICE FRAME. 

IF SERVICE FUNCTIONS, KEYWORD, PHONETIC, AND/OR ORDER ARE PLACED IN 
THE 'ON 1 CONDITION IN THE 'Q' FRAME ANY APPROPRIATE PREPROCESSING OF 
THE INSERTED— SPEC IFXED ANSWER IS ACCOMPLISHED PRIOR TO AN ATTEMPTED 
MATCH. 



206 Page 207 blank 



ONCE A RESPONSE HAS BEEN INSERTED, THE PROGRAM ATTEMPTS TO FIND A 
MATCH EITHER WITH A CORRECT ANSWER OR AN INCORRECT ANSWER. IF A 
MATCH OCCURS, THE PROGRAM EXECUTES THE ACTION AS SPECIFIED BY THE CD. 
IF A MATCH DOES NOT OCCUR THERE ARE TWO ALTERNATIVES FOR ACTION. 

IF THE INSERTED RESPONSE IS NOT A SINGLE LETTER OR DOES NOT MATCH ONE 
OF THE TAGS IN THE ANSWER SETS IN A 'M' FRAME. THE PROGRAM FORCES 
THE USER TO CHOOSE ONE OF THE INDICATED LETTERS. HOWEVER, IF IT IS A 
'Q' TYPE FRAME, THE PROGRAM AUTOMATICALLY SEEKS TO DETERMINE THE 
SUBSEQUENT ACTION. 

NOW, LET'S HAVE THE PERSON AT THE OTHER CONSOLE ACT AS A COURSE 
DESIGNER AND CONSTRUCT SEVERAL FRAMES FOLLOWING THE PREPARED SCRIPT TO 
VERIFY GROUP 3 CONSTRUCTION. 

AGAIN, HE MUST 'GET' THE LESSON AND CONTINUE TO BUILD FRAMES. THE 

COM4AND HE INSERTS TO BUILD ADDITIONAL FRAMES IS: 

* 

CO 

YES, 'CO' IS THE COMMAND TO CONTINUE TO BUILD FRAMES. 

THE FIRST TEST WILL BE TO CONSTRUCT ONE FRAME UP TO GROUP 3 AND THEN 

INPUT THE GROUP EXIT INDICATOR PRIOR TO ENTERING ANY DATA IN THE 

GROUP 3. THE PROGRAM WILL OUTPUT THE CUE: 



G.k ACTIONS 

INDICATING THE NEXT GROUP CAN BE CONSTRUCTED. 

THE CD WILL INPUT THE FRAME EXIT INDICATOR AND RECEIVE THE CUE TO 
BUILD THE NEXT FRAME. 

A SECOND FRAME WILL AGAIN BE CONSTRUCTED UP To GROUP 3. THIS TIME 
THE CD WILL INSERT THE FRAME EXIT INDICATOR PRIOR TO ENTERING ANY 
DATA. THE PROGRAM WILL OUTPUT THE FRAME CUE: 

Q,M,D,C 
INDICATING THE NEXT FRAME CAN BE CONSTRUCTED. 

THIS FRAME EXIT INDICATOR IS A CHARACTER. 

(TYPE THE CHARACTER) 

* 

A 

NEGATIVE 

THE CORRECT ANSWER IS $ 
AFTER THE CD HAS COMPLETED THE ABOVE ACTIONS, TYPE GO. 
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jfeet lbl cd 
P6I769 

ALLOW TRAINEE ACCESS?Y/N 

Y 

ENTER COMMAND 

#co 

Q,M,D,C 
*. 

<1 

FRAME 1 3.0 LABEL 

*. 

A 

G.2 TEXT 

*. 

$ 

Q,M,D,C 

*. 

Q. 

FRAME 1 1f .0 LABEL 
* 

gp3 

G.2 TEXT 

*. 

group test 3 

*. 

A 

G.3 ANSWERS 

*. 

A 

G.k ACTIONS 

*. 

$ 
Q,M,D,C 

*. 

m 

FRAME 15.0 LABEL 

*. 

A 

G.2 TEXT 

*. 

group 3 test 

*. 

A 

G.3 ANSWERS 
*. 

Q,M,D,C 
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go 
FINE. 

THE NEXT SERIES OF FRAMES THE CD WILL CONSTRUCT ILLUSTRATES LEGAL 
AND ILLEGAL FORMATS FOR INSERTING ANSWER TAG— RESPONSES AND SERVICE 
FUNCTIONS. THERE ARE SEVERAL RESTRICTIONS: 

THE ANSWER TAG MUST BE A SINGLE CHARACTER (A-Z) AND BE THE FIRST 
NONBLANK CHARACTER FOLLOWING THE CUE—*. 

A 'BLANK' OR V MUST FOLLOW THE ANSWER TAG. THE '+' SERVES AS AN 
INDICATOR TO THE PROGRAM To CONSIDER THE ANSWER AS CORRECT WHEREAS, 
THE BLANK INDICATES THOSE ANSWERS ARE TO BE CONSIDERED INCORRECT IF 
A MATCH OCCURS. 

WHEN THE CD INPUTS AN ILLEGAL ANSWER FORMAT, THE PROGRAM WILL 
INDICATE 

ILLEGAL SECOND CHARACTER 

AND ALLOW THE CD TO CORRECT THE ENTRY. THIS WILL BE /OTEMPTED TWICE 
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q 

FRAME 16.0 LABEL 

*. 

A 

G.2 TEXT 

*. 

group 3 test 

*. 

AA 

G.3 ANSWERS 

*. 

ab 

ILLEGAL SECOND CHARACTER 

*. 

c$. 

ILLEGAL SECOND CHARACTER 
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THE FORMAT FOR INSERTING LEGAL SERVICE FUNCTIONS REQUIRES THAT A 
NUMERIC TAG BE USED, (0 OR 1-9). 

THE TAG TELLS THE PROGRAM TO PROCESS THE SERVICE FUNCTION FIRST 
AND THEN THE REST OF THE GROUP, WHEREAS THE TAGS 1-9 INDICATE THE 
SERVICE FUNCTION WILL BE PROCESSED WHEREVER IT IS FOUND IN THE GROUP. 

FOR EXAMPLE: 

SET ORDER ON (PROCESS ME FIRST) 
A+RED 

B WHITE 

1 PHONETIC OFF (PROCESS ME HERE. IF A OR B IS MATCHED, I AM 

BYPASSED) 
C BLUE 

THE CD WILL MAKE FOUR ATTEMPTS To INPUT LEGAL AND ILLEGAL SERVICE 
FUNCTIONS. FOR EACH ILLEGAL ATTEMPT THE PROGRAM SHOULD INDICATE: 

ILLEGAL SERVICE FUNCTION WAS INPUT 

AND PERMIT THE CD To REINSERT A CORRECT ENTRY. 

THE SECOND CHARACTER IN A LEGAL ANSWER FORMAT MUST BE A BLANK OR 

A 

* 

+ 

A PLUS FOR YOU. 
THE CD WILL ALSO CONSTRUCT THREE ANSWERS USING THE SAME ANSWER TAG. 

A ONE 
A TWO 
A THREE 

THIS IS LEGAL WITHIN THE CDTS, BUT IT IS IMPORTANT FOR THE CD To ENSURE 

THE ANSWERS ARE EQUIVALENT AND IN THE DESIRED ORDER. REMEMBER, THE 
PROGRAM PROCESSES THE GROUP— TOP TO BOTOM, AND LEFT To RIGHT. 



WHEN THE CD HAS CONSTRUCTED FRAME 17.0, TYPE GO. 

* 
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keyboard on 



ILLEGAL SERVICE JUNCTION WAS INPUT 

*. 

3 ordor on 

ILLEGAL SERVICE JUNCTION WAS INPUT 

*. 

T phonetic off 

*. 

keyword on 

*. 

a+right 

*. 

a+two 

*• 

a+three 

*. 

$ 
Q,M,D,C 

*. 

q. 

FRAME 17.0 LABEL 
*. 

A 

G.2 TEXT 
*. 

group 3 test 

*. 

A 

G.3 ANSWERS 
*. 

a+true 

* 

1 phonetic on 

*. 

b wrong 

* 
© 

2 order off 
*• 

c one 



Q,M,D,C 
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go 

FINE. 

THE REMAINING FRAMES CONSTRUCTED BY THE CD WILL BE To CONSTRUCT 

SEVERAL LEGAL GROUP THREES WITH LEGAL SERVICE FUNCTIONS INTERSPERSED 

AMONG THE ANSWERS. THE EMPHASIS WILL BE TO INDICATE THAT VARIOUS 

NUMBERS OF CORRECT ANSWERS OF VARYING LENGTHS CAN BE TAGGED WITHIN A 
SPECIFIC GROUP 3 AS LONG AS FRAME CAPACITY IS NOT EXCEEDED. 



BY THE WAY, THE NUMBER OF CHARACTERS ALLOWED WITHIN A GIVEN FRAME IS? 
A 20 

B 30 
C k0 

D 300 

c 

RIGHT 
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m 

FRAME 18.0 LABEL 

*• 

A 

G.2 TEXT 
*. 

group 3 test 

*• 

A 

G.3 ANSWERS 

*. 

a+one 

*. 

t> two 

*• 

c three 

*. 
d f our 
*. 
$ 

*. 

q 

FRAME 19.0 LABEL 
*• 

A 

Go2 TEXT 

*. 

group 3 test 

*. 

A 

G*3 ANSWERS 

a+a 

*• 
$ 

Q,M,D,C 
*. 

q 

FKAME 20*0 LABEL 
*. 

A 

G.2 TEXT 

*. 

grooup 3 test 
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THE CD WILL HOW CONSTRUCT A FRAME TO EXCEED THIS CAPACITY. AFTER THIS 
IS COMPLETED TYPE: GROUP k 
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a this 

*• 

b is 

* 

• 

c+an 

*• 

d example 

* 

• 

e of sevearal possible answers 

*. 

f+vithln a single group 3 and i*m glad 

*. 

Q,M,D,C 

*. 

q 

FRAME 21 .0 LABEL 

A*. 
A 

G.2 TEXT 
*• 

one-— ------ — --------- — _________________ 

*. 
two — 

*• 

A 

G.3 ANSWERS 

*. 

a+the united states of america. 

*. 

b the united states air force. 

*. 

c now is the time for all good men to come to the aid of their country. 

*. 

e 

*. 

f - 

FRAME CAPACITY REACHED. DELETE LINES TO CONTINUE 

*. 

#save done 
SAVED 
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group h 

FINE HERE IS GROUP k 

NOW WE WILL EXAMINE THE CONSTRUCTION AND VERIFICATION OF GROUP k. 

THIS IS THE LAST LEGAL GROUP WHICH CAN BE CONSTRUCTED AND ENTERED 
WITHIN A 'Q' OR 'M' FRAME. 

IT IS USED BY THE CD TO SPECIFY THE ACTIONS TO TAKE AS THE RESULT OF 
ANSWERS INSERTED BY THE USER EXECUTING THE LESSON. 

THE PROCESSING OF THIS GROUP IS IDENTICAL WITH THE PREVIOUS GROUPS 
DISCUSSED. (I.E. TOP TO BOTOM, LEFT TO RIGHT). BASED UPON THE COM- 
PARISON OF THE INSERTED RESPONSE WITH THE SPECIFIED ANSWERS, THE PRO- 
GRAM EXAMINES GROUP h TO DETERMINE THE SUBSEQUENT ACTION. 



REGARDLESS OF FRAME TYPE, ('Q' OR 'M' ), ANSWERS ARE SPECIFIED 
IN GROUP . 

3 

YES, GROUP 3. 

EACH LINE IN THIS GROUP MUST START WITH EITHER AN: 



ANSWER TAG (A-Z) 
ACTION COMMAND (F:, C: , R:, B: ) 
ITEM INDICATOR (PERCENT), OR AN 
UNANTICIPATED RESPONSE INDICATOR (-) 



THE UNANTICIPATED RESPONSE INDICATOR APPLIES ONLY TO THE QUESTION 
FRAME. 

THERE CANNOT BE ANY UNANTICIPATED RESPONSES WITHIN A MULTIPLE-CHOICE 
FRAME SINCE THE PROGRAM FORCES THE USER TO CHOOSE ONE OF THE LETTERS 
FROM THE ALTERNATIVE-ANSWER SETS WHICH ARE PRINTED OUT. 

FOR EXAMPLE 

TO MOVE ONTO THE NEXT FRAME IN THIS DEMONSTRATION YOU MUST 'PICK' ONE 
OF THE FOLLOWING LETTERS. IF YOU DON'T BELIEVE IT, PICK A LETTER NOT 
REPRESENTED AND SEE WHAT HAPPENS. 
A PICK 
M ONE 
T OF 
Z THESE 
D LETIERS 

x 

CHOOSE ONE OF THE ABOVE LETTERS 
*. 

a 

YOU L>ID IT. 
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THE PROGRAM PROCESSES THE INFORMATION IN THIS GROUP AS FOLLOWS: 



1 ) IF A LINE BEGINS WITH A SYMBOL, THE PROGRAM ASSUMES IT IS NOT 
AN ANSWER TAG OR ACTION COJWAND AND CHECKS TO DETERMINE IF IT IS A 
LEGAL SYMBOL. 

MINUS (-) = UNANTICIPATED RESPONSE INDICATOR 

PERCENT = ITEM NAME INDICATOR 

THE MINUS CAN ONLY BE USED IN THE TYPE FRAME. 

*. 

q 

right, the 'q' frame only. 

tf the symbol is legal, the line is processed. if the symbol is 
illegal, the line is ignored and the program processes the next line 
in sequence or branches to the next frame in the lesson sequence if the 

^inal line of the group is reached. 

no error Message is output. 

2) if the line begins with a leter(s) not followed by a colon 
(?), the program assumes the leter is an answer tag and continues to 
process the line for action commands or items. if an action com4and is 
not found, the program branches to the next frame in the lesson 
sequence. 



IF AN ACTION COMMAND IS NOT FOUND, THE PROGRAM BRANCHES TO THE NEXT 
""RAME IN THE LESSON 3JQUENCE. 

ANSWER TAGS MAY BE ANY LETTER FROM A TO . 

*. 

z 

RIGHT, YOU REMEMBER THE ALPHABET. 

3) IF THE LINE BEGINS WITH A LETTER FOLLOWED IMMEDIATELY BY A 
COLON (: ), THE PROGRAM ASSUMES IT IS AN ACTION COMMAND AND CHECKS TO 
DETERMINE IF THE LETTER IS A LEGAL ACTION COMMAND. 

IF THE ACTION COM-iAND IS LEGAL (F:, C:, R: , B ), PROCESSING OF THE 
LINE CONTINUES. 
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IF THE ACTION COMMAND IS ILLEGAL, THE LINE IS IGNORED AND THE PROGRAM 
PROCESSES THE NEXT LINE IN SEQUENCE OR BRANCHES TO THE NEXT FRAME IN 
THE LESSON SEQUENCE IF THE FINAL LINE OF THE GROUP IS REACHED. 

IF A MATCH OCCURS WITH A CORRECT ANSWER INDICATED BY THE PLUS SIGN (+) 

TO THE RIGHT OF THE ANSWER TAG IN GROUP . 

* 

• 

3 

YES 

THE PROGRAM SEARCHES THE GROUP TO DETERMINE IF A SIMILIAR TAG EXISTS 

IN GROUP h. IF FOUND, THE ACCOMPANYING ACTION COMMAND, IF ANY, IS 
EXECUTED. IF A MATCH OCCURS WITH AN INCORRECT ANSWER (NO PLUS SIGN), 

THE PROGRAM LOOKS FOR A SIMILIAR TAG IN GROUP h. 

IF FOUND, THE ACCOMPANYING ACTION COMMAND, IF ANY, IS EXECUTED. 

THE PROGRAM PROVIDES FOR UNANTICIPATED RESPONSES IN THE 'Q' FRAME ONLY. 
IF A MATCH DOES NOT OCCUR IN GROUP 3, THE PROGRAM LOOKS IN GROUP k TO 
FIND AN ACTION FqR UNANTICIPATED RESPONSES. 



THE UNANTICIPATED RESPONSE INDICATOR IS A 



CHECK 

IN THIS MANNER, THE CD CAN PROVIDE FOR THREE TYPES OF ANSWERS: 

CORRECT ANSWERS (THERE MAY BE MORE THAN ONE ACCEPTABLE 
VARIATION— TWO OR 2) 
INCORRECT ANSWERS 
UNANTICIPATED ANSWERS (i DON'T KNOW WHAT THE STUDENT WILL INPUT 

BUT LET'S PROVIDE SOME ACTION) 

IF SPECIFIC ACTIONS FOR INSERTED RESPONSES ARE NOT PROVIDED (PLANNED 
OR NOT), THE PROGRAM AUTOMATICALLY BRANCHES TO THE NEXT FRAME IN 
THE LESSON SEQUENCE. 



THE ACTIONS ARE CONTROLLED BY THE USE OF THE ACTION COMMANDS IN 
ASSOCIATION WITH THE ANSWER TAGS. AS MENTIONED EARLY, THE FOUR ACTION 
COMMANDS AVAILABLE ARE. F : , C: , R:, AND B 

F: IS USED FOR SPECIFYING FEEDBACK MESSAGES 

F: YOU'RE ON THE RIGHT TRACK. 

F:YES, RED IS A PRIMARY COLOR 

FrYOU HAVE ALL THE CONCEPTS CORRECT, KEEP UP THE GOOD WORK. 
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IF THE PROGRAM ENCOUNTERS AN ITEM NAME INDICATOR (WHICH IS THE): 

A PERCENT 

B MINUS 

C DOLLAR SIGN 

D QUESTION MARK 

* 

CHOOSE ONE OF THE ABOVE LETTERS 

b 

NO, THAT IS USED FOR UNANTICIPATED RESPONSES. TRY AGAIN. 

*. 
5ha 

YES, IT IS THE PERCENT. 
ITEMS CAN BE USED LIKE COUNTERS. WHEN AN EVENT HAPPENS (A RIGHT OR 

WRONG ANSWER, SEE A FRAME OR FRAMES, ETC. ), A MARK IS ENTERED ONTO A 
TALLEY SHEET, OR AS THEY SAY IN THE WORLD OF PROGRAMMING— INCREASE THE 
INDEX (ITEM) BY A GIVEN AMOUNT. 

CDTS PERMITS THE USE OF THIRTY ITEMS (30) WITHIN A GIVEN LESSON. 
ITEM0 THROUGH ITEM29 ARE THE ONLY LEGAL ITEM NAMES. EACH ITEM CAN HAVE 
A NUMERICAL VALUE ASSIGNED. THE VALUE MUST BE A POSITIVE INTEGER WITH 
A RANGE OF TO 255. 

EACH ITEM CAN BE: 

SET EQUAL To AN INTEGER VALUE— -ITEM10= 150 
TESTED FOR AN INTEGER VALUE— IF ITEM3 EQ k 

SET EQUAL To ANY LEGAL ITEM PLUS OR MINUS AN INTEGER VALUE 

rrEM25»ITEM25+1 

ITEMS CAN ONLY BE USED IN GROUP k OF THE 'Q' OR 'M 1 FRAME TYPES. (THEY 
CAN BE USED IN THE GROUP 2 OF THE 'D' FRAME) 

ITEMS OCCURING AT THE BEGINNING OF GROUP k ARE EXECUTED UNCONDITIONALLY 
IF THE EXPRESSION IS LEGAL. AN ITEM MAY PRECEDE OR FOLLOW A TAG- ACTION 
COfciAND, BUT A SPACE MUST SEPARATE THE EXPRESSION. MORE THAN ONE ITEM 
EXPRESSION CAN BE INSERTED ON A SINGLE LINE BUT A SPACE MUST 
SEPARATE THE EXPRESSIONS. 

NOW THEN, THE LEGAL ACTIONS COMMANDS ARE: 

:, R:, C:, B: 

*. 

f: 
RIGHT. 
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IF A MESSAGE IS NOT SPECIFIED BY THE CD, THE PROGRAM RANDOMLY SELECTS 
AND PRINTS AN APPROPRIATE MESSAGE. 

true, fine, ok, etc. for correct answers or 

negative, false, incorrect, etc. for incorrect answers. 

(c*. ) is used to printout the correct answer as indicated by the plus 
sign in group three. if there are several correct answers (plus signs) 
which answer do you think is printed: 
a the first answer 

b selected randomly 

c the last answer 
*. 

a 

RIGHT, THE FIRST ANSWER ENCOUNTERED WITH A PLUS SIGN IS PRINTED. 

R: (REPEAT THE FRAME) IS USED TO SPECIFY FEEDBACK MESSAGES REQUIRING 

ANOTHER ANSWER. 

R YOU HAVE THE WRONG NAME. TRY AGAIN. 
R:READ THE PARAGRAPH AND TRY AGAIN. 
R.-YOU'RE NOT EVEN CLOSE. TRY AGAIN. 

IF NO FEEDBACK IS PROVIDED THE PROGRAM PRINTS OUT: 

WRONG TRY AGAIN 

AND WAITS FOR ANOTHER INSERTED RESPONSE. 

B: (BRANCH) IS USED TO DISRUPT THE SEQUENCE OF THE LESSON FLOW BY 

PERMITTING THE BRANCHING TO ANOTHER FRAME OR LESSON. 

THE ORDER OF EXECUTION FOR ACTION COMMANDS IS F : , C : , R : , AND B: 

TO REPEAT A FRAME THE CD COULD USE THE , AS OPPOSED TO THE B: . 

r* 

'WRONG 

THE CORRECT ANSWER IS R: 

THE B: COULD BE USED SINCE IT IS LEGAL TO BRANCH TO THE FRAME BEING 
EXECUTED, BUT THE R: IS NORMALLY USED FOR THIS. 

FINALLY, ACTION COMMANDS PRECEDED BY AN ANSWER TAG ARE EXECUTED ONLY IF 
THE INSERTED REPLY MATCHES AN ANSWER BEARING THAT TAG. 
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WHICH OF THE FOLLOWING ANSWER TAGS-ACTION COMMANDS STARTING A LINE IN 

GROUP k ARE LEGAL IN FORMAT. 

A A F: 

B BCD R 

C EFGHI R 

D ALL OF THE ABOVE 

E NONE OF THE ABOVE 

* 

d 

EXCELLENT. 

THE PROGRAM PROVIDES THE CD WITH HOW MANY ITEMS. 

30 

YES TO 29 IS 30 ITEMS. 

UNANTICIPATED RESPONSES ARE PERMITTED AND IDENTIFIED IN GROUP k BY USE 
OF THE SYMBOL. 



VERY GOOD 

NOW, AS WITH THE PREVIOUS CONSTRUCTION AND VERIFICATION OF GROUPS 1-3, 
WE WILL HAVE THE PERSON AT THE OTHER CONSOLE ACT AS A COURSE DESIGNER. 



HE WILL ONCE AGAIN 'GET' THE LESSON AND CONTINUE TO BUILD FRAMES. 

THE FIRST TEST WILL BE To CONSTRUCT ONE FRAME UP TO GROUP k AND THEN 
ENTER THE FRAME EXIT INDICATOR PRIOR TO ENTERING ANY DATA IN THE 
GROUP k. THE PROGRAM WILL OUTPUT THE CUE: 

Q,M,D,C 

TO ALLOW THE CD TO SELECT THE NEXT FRAME. 

A SECOND FRAME WILL AGAIN BE CONSTRUCTED UP TO GROUP k. THIS TIME THE 
CD WILL INSERT THE GROUP EXIT INDICATOR PRIOR TO ENTERING ANY DATA. 
THE PROGRAM WILL OUTPUT THE FRAME CUE AGAIN SINCE THIS IS THE 
LAST LEGAL GROUP WHICH CAN BE CONSTRUCTED WITHIN A FRAME. 



THE GROUP EXIT INDICATOR AND FRAME EXIT INDICATOR MUST BE: 

A THE FIRST BLANK CHARACTER ENTERED AFTER THE *, 
B THE FIRST NONBLANK CHARACTER ENTERED AFTER THE * 
C INSERTED IN GROUP *♦ ONLY 

D INSERTED IN. GROUP 2 ONLY 

* # 

a 

NO 

THE CORRECT ANSWER IS THE FIRST NONBLANK CHARACTER ENTERED AFTER THE *. 

AFTER THESE TWO FRAMES HAVE BEEN CONSTRUCTED TYPE GO 
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#get Ibl cd 
061769 

ALLOW TRADE ACCESS?Y/N 
Y 
ENTER COMMAND 

#co 
Q,M,D,C 
*. 

q 

FRAME 21 .0 LABEL 

* 

• 

gpU 

G.2 TEXT 

*. 

group k test 

*. 

A 

G.3 ANSWERS 
*. 

A 

G.k ACTIONS 

*. 

$ 

Q,M,D,C 

*. 

q 

FRAME 22.0 LABEL 

*. 

A 

G.2 TEXT 

*. 

$ 

Q,M,D,C 

*. 

q 

FRAME 23.0 LABEL 
*. 

A 

G.2 TEXT 

*. 

group h test 

*. 

A 

G.3 ANSWERS 
*. 

A 

G.k ACTIONS 
*. 

A 

Q,M,D,C 
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go 

FINE 

NOW THE CD WILL CONSTRUCT A FRAME IN WHICH HE EXCEEDS THE FRAME 
CAPACITY OF k00 CHARACTERS. ALSO WITHIN THIS FRAME HE WILL DEMONSTRATE 
THE USE OF ANSWER TAGS, ACTION COMMANDS AND ITEMS. 



THE ANSWER TAOS USED MUST BE LETTERS WHICH CAN RANGE FROM A TO . 

* 

z 

FINE 

ITEMS CAN BE SET IN A 'Q* OR 'M' FRAME WITHIN GROUP — . 

* 

k 

GOOD 

AFTER THE CD COMPLETES THIS FRAME, TYPE GO 

* 

• 

go 

YES 

THE CD CAN INSERT A SERVICE FUNCTION KEYWORD, ORDER, 

OR PHONETIC *HICH IS ILLEGAL. THE PROGRAM DOES NOT INDICATE THIS IS 

AN ERROR CONDITION WHEN THE FRAME IS BEINO BUILT, BUT WILL IGNORE THE 
SERVICE FUNCTION DURING LESSON EXECUTION. THIS COULD AFFECT THE DESIRED 

PROCESSING OF A PARTICULAR FRAME OR SET OF FRAMES. 

THE ONLY GROUP A SERVICE FUNCTION CAN BE LEGALLY INPUT IS GROUP . 

* # 

33 

GOOD 

AND THE ONLY FRAME TYPE IN WHICH THE SERVICE FUNCTIONS WILL OPERATE IS: 

A Q 

B M 

C D 

D C 

* p 

a 

OK 

THE CD COULD ALSO CONSTRUCT ILLEGAL ITEM FORMATS WHICH WOULD BE /CCEPT- 

ED DURING LESSON BUILDING BUT WOULD CAUSE ERROR CONDITIONS TO OCCUR 
DURING LESSON EXECUTION. IF NAME IS NOT ITEM0 THROUGH ITEM29, THE 
PROGRAM WILL OUTPUT: 

ILLEGAL ITEM NAME 

IF THE ITEM VALUE IS NOT A POSITIVE INTEGER OR OUTSIDE THE RANGE OF 
TO 255, THE PROGRAM INDICATES: 

ILLEGAL ITEM VALUE 
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FRAME 2k, LABEL 

*. 

A 

G.2 TEXT 

*. 

the air force receives stellar guidance from the air staff 

*. 

A 

G.3 ANSWERS 
*. 

A 

G.U ACTIONS 

*. 

a ftthis will demonstrate the use of tags and 

*. 
b fraction commands which can be used in group U 
*. 

b rrthis group can also be used to Set items 
*. 
-f: c: 



#:item1=3 #:item2-5 #:item25=15l+ 



c f r Kaaaaaaaaaaaaaaaaaaas asasasasasasasaaasasasasasasasasasasasasasasasasasasasas; 

d f : asasasasasasa^asasssaaaasasasasasasasasasasasasasasasasasasasasasasasasasaasa 
FRAME CAPACITY REACHED. DELETE LINES TO CONTINUE 
». 

#save done 
SAVED 
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IN EITHER OF THESE CASES, THE PROGRAM PERMITS EXECUTION TO CONTINUE 
AT THE OPTION OF THE USER, BY GOING TO THE NEXT FRAME IN THE 
LESSON SEQUENCE. 

VARIOUS COMBINATIONS OF ACTION COMMANDS AND ITEM SETTINGS AND USES 
WILL BE DEMONSTRATED DURING LESSON EXECUTION. 

THIS COMPLETES THE SECTION ON LESSON BUILDING 



NOW THAT WE HAVE PRESENTED THE FEATURES OF GROUP 1 THROUGH k CONSTRUC- 
TION FOR THE 'Q', 'M 1 , AND 'D' FRAMES, WE WILL CONSIDER HOW THE CDTS 
PERMITS A COURSE DESIGNER TO MODIFY HIS LESSON MATERIAL. 

LESSON EDITING 

THERE ARE TWO BASIC EDITING CAPABILITES PROVIDED WITHIN THE CDTS. 

THESE ARE INSERTION AND DELETION. A THIRD FEATURE PRINTING, WHILE NOT 
A LESSON MODIFICATION JEATURE PERMITS THE CD TO QUALITY CONTROL HIS 
LESSON MODIFICATION WORK. 

THE COMMANDS To ACCOMPLISH THESE ACTIVITIES ARE: 
I (INSERT) 



THE TRAINING SYSTEM DETERMINES THE LEVEL OF INSERTION EESIRED: 
FRAME, GROUP, OR LINE AND WHETHER THE INSERTION IS TO OCCUR WITHIN 
EXISTING MATERIAL OR BE ADDED To THE LESSON MATERIAL. 

IF A SINGLE LINE IS SPECIFIED, THE PROGRAM PRINTS OUT THE REQUESTED 
LINE FOR EASY REFERENCE AND CHANGES ARE ENTERED. THIS NEW LINE OF 
INFORMATION REPLACES THE OLD LINE IN THE LESSON. 

D (DELETION) 



THE TRAINING SYSTEM DETERMINES THE LEVEL OF DELETION FRAMES, GROUPS 
WITHIN FRAMES, OR LINES WITHIN GROUPS AND REMOVES THE MATERIAL FROM 
THE LESSON. 

P (PRINT) 



PERMITS THE ON-LINE PRINTOUT OF SELECTED COURSE MATERIAL BY THE CD FOR 
VISUAL QUALITY CONTROL. ONLY A RANGE OF THREE (3) FRAMES PER REQUEST 
CAN BE PRINTED ON-LINE. 
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THE GENERAL FORMAT FOR USING THESE COMMANDS IS: 

#C, F1-F2, G1-G2, L1-L2 

C IS THE COMMAND--I, D, P 
F1-F2 ARE FRAME NUMBERS, 
G1-G2 ARE GROUP NUMBERS WITHIN A FRAME, 
L1-L2 ARE LINE NUMBERS WITHIN A GROUP. 

THERE ARE SEVERAL CONDITIONS AND RESTRICTIONS: 

1 ) FRAMES MUST BE SPECIFIED. 

2) LINES MAY BE OMITTED IN SOME CASES. 
3) GROUPS MAY BE OMITTED IN SOME CASES. 

k) IF A LINE IS SPECIFIED, A GROUP MUST BE SPECIFIED. 
5) IF A GROUP IS SPECIFIED, A FRAME MUST BE SPECIFIED. 

6) INSERTION OF COURSE CONTENT IS RESTRICTED TO A SINGLE FRAME, 
GROUP OR LINE PER INSERTED COMMAND. 
7) A COMMAND MUST BE SPECIFIED. 



THESE LEGAL COMMANDS ARE P, I AND . 

d 

YES, D FOR DELETE. 

WHAT DOES I STAND FOR 

* 

. 

insert 

YES, INSERT. 

THEN OF COURSE THAT LEAVES P FOR , 

* 

• 

print 

RIGHT 

THE INITIAL USE OF AN EDITING COMMAND REQUIRES THE USE OF THE NUMBER 

SYMBOL (#) PRECEDING THE COMMAND. THEREAFTER, IF SUCCESSIVE EDITING 

COMMANDS ARE ENTERED, THE # CAN BE OMITTED. 
FOR EXAMPLE: 

#13 2 1 IS THE INITIAL ENTRY INTO EDITING. 

D,J+,J+,5 SUBSEQUENT EDITING COMMAND. 

NO SPACE IS PERMETIED BETWEEN THE # AND THE COMMAND WHEREAS A SPACE OR 
COMMA MUST SEPARATE THE REMAINING ELEMENTS OF THE EXPRESSION. 
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NOW, TO DEMONSTRATE AND VERIFY THESE EDITING COMMANDS WE WILL USE THE 
SERVICES OF THE PERSON AT THE OTHER REMOTE TERMINAL. 

A SPECIAL LESSON CALLED 'EDIT' HAS BEEN CONSTRUCTED WHICH WILL 
SERVE AS THE TEST VEHICLE. 

THE CD WILL 'GET* THIS LESSON AND FOLLOWING A SCRIPT PERFORM 
VARIOUS EDITING. THE INSERT COMMAND WILL BE DEMONSTRATED FIRST (SINCE 
WE WANT SOMETHING LEFT) AND THEN FOLLOWED BY THE DELETE COMMAND. THE 
PRINT COMMAND WILL BE VERIFIED BY VISUALLY CHECKING THE RESULTS OF THE 
OTHER TWO COMMANDS. 
AFTER EACH LEGAL EDITING COMMAND, THE PROGRAM WILL OUTPUT: 

DONE 



AND AWAIT THE NEXT COMMAND. 

THE FIRST SERIES OF INPUTS WILL BE ILLEGAL INSERTIONS. THE PROGRAM 
OBVIOUSLY DOES NOT PERMIT A LINE TO BE INSERTED INTO A NONEXISTENT 
FRAME. THE PROGRAM ALSO RESTRICTS THE CD FROM INSERTING A NEW 
GROUP OVER AN EXISTING GROUP. THE EXISTING GROUP MUST BE 'DELETED' 
PRIOR TO USING THE INSERT COMMAND. 

THE PROGRAM PERMITS THE INSERTION OF A NEW FRAME BUT THE FRAME NUMBER 
MUST BE LEGAL (I.E., NUMERIC AND LESS THAN 999.9). 

THE PROGRAM ALSO RESTRICTS THE USE OF THE INSERT COMMAND TO A SINGLE 
LINE, GROUP OR FRAME. 

FOR EACH ILLEGAL INSERTION ATTEMPT THE PROGRAM WILL OUTPUT AN APPRO- 
PRIATE ERROR MESSAGE. 

'ILLEGAL GROUP/LINE NUMBER' 

FOR ATTEMPTING TO INSERT A GROUP OR LINE INTO A NONEXISTENT FRAME, 
THE MESSAGE: 

'ILLEGAL LABEL OR FRAME NUMBER 

IS OBVIOUS. 
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#get edit cd 
061769 

ALLOW TRAINEE ACCESS7Y/N 
Y 
ENTER COMMAND 

#i 17.5 

ILLEGAL GROUP/LINE NUMBER 

♦. 

#1 39.7 3 2 

ILLEGAL GROUP/LINE NUMBER 
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THE CD WILL ALSO ATTEMPT TO INSERT ILLEGAL LABELS. A LABEL MUST BE 
ALPHANUMERIC AND CONTAIN NO MORE THAN ONE THE FOLLOWING RANGES OF 
CHARACTERS: 

A 0-6 
B 2.12 
C 1-6 
D 1-16 

c 

AFTER EACH ILLEGAL LABEL ATTEMPT OF: 
'ILLEGAL LABEL OR FRAME NUMBER 

LABEL* 123^56 AND ABCDEFG 

THE PROGRAM WILL OUTPUT; 

'ILLEGAL FRAME LABEL' 

AND ALLOW THE CD TO MAKE A LEGAL INSERTION IF DESIRED 

AFTER THIS HAS BEEN COMPLETED TYPE GO. 

# 

go 
OK 

NOW THE CD WILL ATTEMPT TO INSERT ADDITIONAL INFORMATION INTO A FRAME 
AND EXCEED THE FRAME CAPACITY OF — CHARACTERS. 

* 

km 

VERY GOOD, YOU REMEMBERED. 
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i 2U.3 2 

ILLEGAL GROUP/LINE NUMBER 

*. 

i 123U 
ILLEGAL LABEL Cfc FRAME NUMBER 

*. 
i 57.3 6 
ILLEGAL GROUP/LINE NUMBER 

*. 
i, 18-20 

ILLEGAL LABEL CR FRAME NUMBER 
*. 
i k0 1 1 

FRAME k0.0 
Q,M,D 

*. 

<1 

FRAME k0.0 LABEL 
* 

123*^6 

ILLEGAL FRAME LABEL 

FRAME U0.0 LABEL 

*. 
abcdefgh 
ILLEGAL FRAME LABEL 

FRAME k0.0 LABEL 

*• 
#1 37 2 7 
*• 
xasdffdfdfdfdfdfdfdfctf^ 

FRAME CAPACITY REACHED. DELETE LINES TO CONTINUE 
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THIS WILL BE FOLLOWED BY THE CONSTRUCTION OF A NEW FRAME WITHIN THE 
LESSON. FRAME CAPACITY WILL ALSO BE EXCEEDED. 

WHEN THE FRAME CAPACITY IS EXCEEDED THE PROGRAM WILL INDICATE: 

'CAPACITY REACHED. DELETE LINES TO CONTINUE' 

TO VERIFY A LEGAL FRAME CAN BE INSERTED, THE CD WILL CONSTRUCT A 
DECISION FRAME AND THEN USE THE PRINT COMMAND TO VERIFY THE 
CONSTRUCTION. 

AFTER THIS IS COMPLETED TYPE GO 

* 
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#1 ^.5 

Q,M,D 

*. 

q 

FRAME Uk,$ LABEL 

*. 

A 

G.2 TEXT 

*. 
asasnaaaaaanaaanaaanaflaaaaaaaajiaaaaaaaaaaaaa 

*• 

*. 
nbribnbribribribribrib nbnbnbnbribribribribn't < nbiii ribnbnbrib nbribribribn 

*. 
bvbVbvinrbVbvbVbvbvbvbVbVbVbdbvbvb^ 

*. 
iininjmnuxamuiuimnmrmrarMittaiTmruva')iuc)f.T r )jr'Tiji i nam > rn mi :• • 

*. 
nranmnranmnmniim^ a m wii i 

""•IF capacity peached, delete lines to continue 

*. 

#i 2.5 
Q,M,D 

*. 

d 

FRAME 2.5 LABEL 

A 

G.2 CONDITIONS 

*. 

f :thls demonstrates inserting a legal decision frome 

frfghjk 

*. 

$ 

DONE 

*. 

#P 2.5 

FRAME 2.5 

G.2 CONDITIONS 

1 .0 F:THIS DEMONSTRATES INSERTING A LEGAL DECISION FROME 
2.0 FrFGHJK 

DONE 
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go 

FINE. 

AS DISCUSSED IN LESSON BUILDING, GROUP 1 CAN BE USED TO INSERT LABELS 

AND DECISION STATEMENT INDICATORS THE CD WILL ATTEMPT TO INSERT A 

DUPLICATE LABEL, INSERT A NEW LABEL (GOOD) AND REPLACE AN EXISTING 

LABEL (CHART FOR FLOW). 



FOR THE DUPLICATE LABEL ATTEMPT, THE PROGRAM WILL INDICATE: 

'FRAME 39.0 IS USING THAT LABEL' 
AND THEN ALLOW THE CD To INSERT LABEL— GOOD. 

AFTER THE CD VERIFIES THE REPLACEMENT OF LABEL FLOW WITH CHART BY 
PRINTING GROUP 2, TYPE OK. 

t. 

ok 

OK IS OK. 
THE CD WILL ATTEMPT TO INSERT AN ILLEGAL FRAME TYPE (X) AND RECEIVE 
THE MESSAGE: 

'ILLEGAL FRAME TYPE - ONLY Q/H/V CAN BE INSERTED' 

Q,M,D 



YOU WILL NOTE THAT ONE FRAME TYPE— COPY IS MISSING. THE PROGRAM DOES 
NOT PERMIT THE COPY FRAME TO BE INSERTED. IT CAN ONLY BE USED WHEN 
BUILDING A LESSON IN A SEQUENTIAL MANNER. 



THE ATEMPT TO INSERT 'BRANCH TO 106' AND 'WRONG FORMAT' INTO A 
DECISION FRAME WILL TRIGGER THE MESSAGE: 



'REJECTED. ALL DECISION STATEMENTS MUST BEGIN WITH IF, AND, OR, 
END, F:, B , ELSE OR # ' 
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#1 40 1 

FRAME 40.0 

Q,M,D 
*. 

q 

FRAME 140.0 LABEL 

*. 
flow 
FRAME 39.0 IS USING THAT LABEL. 

FRAME 40.0 LABEL 

*, 
gOCK? 

DONE 

*. 

#1 39 1 

FRAME 39.0 LABEL= FLOW 

Q,M,D 

*. 

q 

FRAME 39.0 LABEL 

*. 
chart 
DONE 
*. 
#P 39 1 

FRAME 39.0 LABEL- CHART 
DONE 

#i 8U.5 

Q,M,D 

*. 

x 

ILLEGAL FRAME TYPE - ONLY q/m/D CAN BE INSERTED 

Q,M,D 
*. 

#1 3U 2 5 

B:106 

*. 

branch to 106 

REJECTED. ALL DECISION STATEMENTS MJST BEGIN WITH IF, AND, OR, END, F:, B:, ELSE OR <f>: 
*. 
wrong format 

REJECTED. ALL DECISION STATEMENTS KJST BEGIN WITH IF, AND, OR, END, F:, B:, E1SE OR <f> : 
*. 
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THIS WILL BE FOLLOWED By THE INSERTION OF 'B:120' WHICH IS A LEGAL 
DECISION STATEMENT. 

TYPE FINE AFTER THIS ACTIVITY HAS BEEN COMPLETED. 

fine 

GOOD, LET'S PROCEED. 

THE NEXT SEQUENCE OF EVENTS WILL BE 

A) THREE ATEMPTS TO INSERT SERVICE FUNCTIONS ILLEGALLY, 
B) INSERTION AND VERIFICATION OF A LEGAL SERVICE FUNCTION, 

C) TWO ATTEMPTS To INSERT ILLEGAL GROUP 3 FORMATS AND, 
D) INSERTION AND VERIFICATION OF A LEGAL ANSWER TAG-RESPONSE. 

FOR THE ILLEGAL SERVICE FUNCTION THE PROGRAM WILL INDICATE: 

'ILLEGAL SERVICE FUNCTION WAS INPUT 1 
AND FOR THE IMPROPER GROUP 3 FORMAT, THE MESSAGE: 

'ILLEGAL SECOND CHARACTER' 

WILL BE OUTPUT. 

THE PROGRAM ASSUMES A SERVICE FUNCTION IS BEING ENTERED KffiN A NUMERIC 

TAG IS USED AND PROCESSES THE LINE ACCORDINGLY. WHEN AN ALPHABETICAL 
TAG IS USED THE PROGRAM EXPECTS TO FIND AS THE SECOND CHARACTER IN 
THE LINE OF INPUT A BLANK OR: 
A# 
B + 
C/ 

D $ 

* 

b 

RIGHT. 

AFTER THE LEGAL GROUP 3 FORMAT HAS BEEN VERIFIED BY THE PRINTING OF: 

G.3 ANSWERS 
2.0 B M 
DONE 

TYPE CONTINUE. 
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b:120 

DONE 

*. 

#P 3h 2 5 

G.2 CONDITIONS 
5.0 B:120 
DONE 

*- 

#11 52 3 2 

*. 

h key 

ILLEGAL SERVICE FUNCTION WAS INPUT 

*. 
phonetia on 
ILLEGAL SERVICE FUNCTION WAS INPUT 

*• 
22 order on 

ILLEGAL SERVICE FUNCTION WAS INPUT 

*. 
order on 
DONE 
*. 
#P 52 3 2 

G.3 ANSWERS 

2.0 ORDER ON 
DONE 
*. 

#132 3 2 

• 

ILLEGAL SECOND CHARACTER 
*. 

c-false 

ILLEGAL SECOND CHARACTER 

*. 
"b m 
DONE 

P*32 3 2 
G.3 ANSWERS 

2.0 B M 

DONE 
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continue 

LET'S DO. 

THE CD WILL MAKE FIVE ATTEMPTS TO CHANGE AN EXISTING LINE OF MATERIAL. 
IN EACH CASE, THE PROGRAM PRINTS OUT THE LINE TO BE MODIFIED FOR 
VISUAL INSPECTION AND REFERENCE. ONCE A SINGLE CHARACTER HAS BEEN 
ENTERED, THE ENTIRE LINE HAS BEEN REPLACED. 

THE CD CAN 'CHANGE HIS MIND' AND VOID THE REQUEST BY INSERTING ANOTHER 
EDITING COMMAND PRECEDED BY THE # SYMBOL. THIS PRESERVES THE LINE OF 
INFORMATION IN THE LESSON IN ITS CURRENT STATE. 

AFTER EACH INSERTION, THE CD WILL USE THE PRINT COMMAND TO VERIFY THE 

CHANGE. THE PRINT COMMAND IS - 

* 

P 

VERY GOOD 
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#1 73 ^ 2 

-F: 
*. 
-r: 
DONE 

fc 73 

FRAME 73.0 

G.2 TEXT 

1 .0 CHANGED 

G.3 ANSWERS 

1 .0 A+CUSTOMER 

G.U ACTIONS 
1 .0 A F: 
2.0 -R: 

DONE 
*. 
#1 85.3 3 6 

E DESIGN 

*. 
e designer 
DONE 
*. 
85.3 3 8 

G.3 ANSWERS 

8.0 E DESIGNER 

DONE 
*. 
#1 37 2 2 

TO DEFINE THE PROBIEM. 

*. 
to define a particular problem 
DONE 
*. 
37 2 1-2 

G.2 TEXT 

1 .0 THE CUSTOMER/USER ICTS WITH A FORMULATOR (F) IN AN ATTEMPT 
2.0 TO DEFINE A PARTICULAR PROBIEM 

DONE 

* 
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AFTER VERIFYING THAT 'A F.GOOD' WAS INSERTED, TYPE GO. 

SO 

GOOD. 

THE LAST AREA OF INSERTION DEMONSTRATED WILL BE TO MODIFY THE FRAME 
TYPE AND ADD OR DELETE THE DECISION FRAME INDICATOR. 

TO DO THIS THE CD MUST MODIFY GROUP . 

* 

• 

2 

NO GROUP 1 IS WHERE THIS INFORMATION IS MAINTAINED. 

THE FRAME TYPE AND DECISION FRAME INDICATOR CANNOT BE VERIFIED VISUAL- 
LY BY PRINTING THE GROUP 1 OF A FRAME ON-LINE. ONLY THE FRAME NUMBER 
AND LABEL (IF ANY) ARE PRINTED BY THE PROGRAM ON-LINE. FRAME TYPE CAN 
BE DEDUCED BY EXAIMING THE GROUP CUES 



G.2 TEXT - 'Q' OR 'M' 
G.2 CONDITIONS - 'D' 



OR BY EXECUTING THE FRAME. THE GROUP 3 OF AN 'M' FRAME WILL PRINT 
WHEREAS THE GROUP 3 OF THE 'Q' FRAME WILL NOT. 

ALL GROUP 1 INFORMATION IS PRINTED WHEN THE LESSON IS LISTED OFF-LINE. 

AFTER THE CD HAS COMPLETED MODIFYING SEVERAL GROUP T S, THE INSERT TEST 
WILL BE COMPLETED. TYPE 'DELETE' TO CONTINUE. 

delete 

FINE. ON TO iJELETE. 
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#i 39.5 h 1 
*. 
a f :good 

DCNE 

*. 

39*5 k 1 

G,k ACTIONS 

1 .0 A F:GOOD 
DONE 
*. 
#i 3 1 



FRAME 
Q,M,D 



3.0 



m 
FRAME 

*. 

A 

DONE 
*. 
#12 1 

FRAME 
Q,M,D 



3.0 LABEL 



2.0 



FRAME 

*. 
Z 
DOME 

#i 1 1 

FRAME 
Q,M,D 
. 

ml 

FRAME 
*. 

A 

DONE 



2.0 LABEL 



1.0 



1 .0 LABEL 



LABEL= CO0600 
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THE PROGRAM ACCEPTS INPUTS TO DELETE NONEXISTENT FRAMES, GROUPS OR 
LINES. WHEN THIS OCCURS, THE PROGRAM WILL OUTPUT: 

'DONE' 

INDICATING IT HAS PROCESSED THE REQUEST. IN THIS CASE NOTHING HAS BEEN 
DONE TO THE LESSON. HOWEVER, THE CD MUST EXERCISE CAUTION WHEN USING 
THE DELETE COMMAND SINCE ONCE INPUT THERE IS NO TURNING BACK. 
UNLIKE THE INSERT COMMAND, THE CD CANNOT RETRACT OR 'CHANGE HIS MIND' 
AND INPUT ANOTHER EDIT COMMAND. 

THE CD WILL VERIFY THE ABILITY OF THE PROGRAM TO DELETE EXISTING 
MATERIAL BY USING THE PRINT COMMAND BEFORE AND AFTER EACH DELETION. 



UNLIKE THE INSERT COMMAND, THE PROGRAM HAS NO RESTRICTION ON THE RANGE 
OF FRAMES WHICH CAN BE DELETED. THE PROGRAM WILL DELETE THE ENTIRE 
LESSON, IF DESIRED, ALTHOUOH NOT RECOMMENDED. AGAIN, AFTER EACH DELETE 
THE PROGRAM INDICATES 

'DONE - 
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#d 89.5 
DONE 
*. 
17-19 

FRAME 17.0 

G.2 TEXT 

1.0 DIAGRAM 3 OF YOUR EXHIBIT ILLUSTRATES A - ? (TWO WORDS) 

G.3 ANSWERS 

1 .0 A+FLOW CHART 

2.0 B+FI0W DIAGRAM 

3.0 C+BLOCK DIAGRAM 

h.0 A+FLOW CHARTING 

5.0 B+FI0W DIAGRAMMING 

6.0 C+BIDCK DIAGRAMMING 

FRAME 18.0 

G.2 TEXT 

1.0 THE GRAPHIC REPRESENTATION OF 'HOW' VARIOUS PROCEDURES AND 
2.0 DECISIONS ACCOMPLISH THE TASK OF THE -ROGRAM SYSTEM IS CALLED 

FLOW CHART. 



G 


_)t)U n -------- 

.3 ANSWERS 




1.0 


PHONETIC OFF 




2.0 


A+PROGRAM 




3.0 


B+MICRO 




k.0 


C+DETAILED 




5.0 


D+SPECIFIC 



FRAME 19.0 

G.2 TEXT 

1 .0 THE GRAPHIC REPRESENTATION OF 'WHAT' IS TO BE ACCOMPLISHED 
2.0 DURING THE FLDW OF DATA THROUGH A PROGRAMMING SYSTEM IS 
3.0 CALLED A FIDW CHART. 

G.3 ANSWERS 

1 .0 SET KEYWORD ON 
2.0 PHONETIC OFF 
3.0 E+SYSTEM (GENERALIZED) 
k,0 A+SYSTEM 
5.0 B+MACRO 
6.0 C4GENERAI, 
7.0 D+GENERALIZED 
DONE 
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ONE RESTRICTION THE CD WILL DEMONSTRATE IS THE ATTEMPT TO DELETE A 
GROUP 1 FROM AN EXISTING FRAME. THE PROGRAM WILL OUTPUT: 

'GROUP 1 WAS USED WITH A DELETE COMMAND' 



THE U) WILL CONTINUE To DEMONSTRATE THE ABILITY OF THE PROGRAM TO 
DELETE FRAMES, GROUPS WITHIN FRAMES AND LINES WITHIN GROUPS. 
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#d 17-19 

DONE 

*. 

17-19 

DONE 

*. 

#d 23.1-23.9 

DONE 

GROUP 1 WAS USED WITH A DELETE COMMAND 



H3.5 3 

G.3 ANSWERS 

1 .0 A+FORMULATOR (f) 
2.0 A+FORMULATOR 
DONE 
*. 

#d ^3.5 3 
DONE 
*. 

^3.5 3 

DONE 

*. 
1+3.5 



FRAME U3.5 

G.2 TEXT 

1.0 2) # 
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G.U ACTIONS 
1.0 A F: 
2.0 -F: C: 
DONE 
*. 
l+7h6 2 

G.2 TEXT 

1 .0 ALL OF THESE PEOPLE QUITE NATURALLY HAVE A CORRESPONDING AIR 
2.0 FORCE SPECIALITY (AFS). 

3.0 A FORMULATOR IS TERMED A FUNCTIONAL AREA ANALYST. 
1+.0 A DATA SYSTEMS ANALYST IS THE SPECIALTY WHICH DOES THE JOB 
5.0 OF THE . 

DONE 
*. 

#d 1+6 2 
DONE 
*. 
1+6 

FRAME 1+6.0 LABEL= AFS 

DONE 

*. 

1+6.5 k 

G.1+ ACTIONS 
1 .0 A F: 
2.0 -F: C: 
DONE 

#d 1+6.5 h 

DONE 

*. 

1+6.5 U. 

DONE 
*. 

1+7 3-1+ 

G.3 ANSWERS 
1 .0 A+CODER 

G.1+ ACTIONS 

1 .0 A F: 

2.0 -F: C: 
DONE 
*. 

#d 1+7 3-1+ 
DONE 
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FRAME U7.0 

G.2 TEXT 

1 .0 THE PROGRAMMER SPECIALIST PERFORMS THE SAME JOB AS THE 

DONE 
*. 
55 2 2-3 

G.2 TEXT 

2.0 'WHAT' IS TO BE DONE THE OTHER GETS DOWN TO THE 

3.0 SPECIFICS AND SHOWS 'HOW' IT WILL BE ACCOMPLISHED. 

DONE 

*. 

#d 55 2 2-3 

DONE 

*. 

55 2 \-h 

G.2 TEXT 

1 .0 THERE ARE TWO TYPES OF FLOW CHARTS. ONE TYPE ILLUSTRATES 
U.0 THE TWO TYPES CAN BE THOUGHT OF AS BEING A GENERAL FLOW AND 
DONE 

*. 

55.5 3 2-3 

G.3 ANSWERS 

2.0 C+DETAILED 
3.0 A+MICPO 
DONE 
*. 

#d 55.5 3 2-3 
DONE 
*. 
55.5 3 1-U 

G.3 ANSWERS 

1 .0 PHONETIC OFF 
4.0 B+SPECIFIC 
DONE 



257 



WHEN THIS ACTIVITY IS COMPLETED, TYPE END. 

• 
end 

VERY GOOD. 

NOW, SELECT ONE OF THE FQLLOWUNG. 
A I WISH TO BRANCH TO THE NEXT TEST 
B I WISH TO TAKE A BREAK. 

b 

PLEASE TYPE *CLQSE. 



End of Day 2 Formal Qualification Testing 
Trainee 
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70.6 h 5-6 

G.k ACTIONS 
5.0 E B:ADV 
6.0 F B:SYMB 
DONE 
*. 

#d 70.6 h 5-6 
DONE 
*. 
70.6 k U-7 

G.U ACTIONS 

k.0 D B:T3fPES 
7.0 G F:O.K., ON WITH THE QUESTIONS. B:72 
DONE 



End of Day 2 Formal Qualification Testing 
Course Designer 
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*open for e 1 61952722 

ENTER INITIAL COMMAND TO CDTS. 

?get demo02 salvage 

069168 

THE SAVE COMMAND 
***************** 



THE SAVE COMMAND ALLOWS THE COURSE DESIGNER TO SAVE, ONTO DISK STORAGE, 
THE LABEL INFORMATION AND FRAME DIRECTORY OF THE LESSON BEING CON- 
STRUCTED, AND ALLOWS HIM TO ACCESS A DIFFERENT LESSON. 
(VIA THE GET OR CO COMMANDS) 



THERE ARE ACTUALLY TWO FORMS OF THE SAVE COMMAND 

1) SAVE 

2) SAVE DONE 

A SIMPLE "SAVE" INSURES THAT ALL DATA FOR THE LESSON BEING CONSTRUCTED 
IS SAVED ONTO DISK, To PROTECT AGAINST A COMPUTER OR PROGRAM FAILURE 
CAUSING THIS INFORMATION TO BE LOST. THE SIMPLE SAVE SHOULD BE EXECUTED 
AT PERIODIC INTERVALS To MINIMIZE LOSS OF EFFORT. 

THE "SAVE DONE" COMMAND IS USED BY THE COURSE DESIGNER TO INDICATE TO 
CDTS THAT NOT ONLY DOES HE WANT HIS LESSON MATERIAL "SAVED", BUT ALSO 
THAT HE HAS COMPLETED WORK ON THIS LESSON FOR THE TIME BEING. 

IF A COURSE DESIGNER DECIDES THAT HE WISHES To TERMINATE CONSTRUCTING 
OR MODIFYING A PARTICULAR LESSON AND GET ANOTHER, HE WOULD INPUT THE: 
A SAVE COMMAND 
B SAVE DONE COMMAND 

b 

FROM THE ABOVE DISCUSSION IT IS OBVIOUS THAT THE SAVE COMMAND SHOULD 
NOT BE A LEGAL INPUT TO THE SYSTEM FROM A STUDENT. TO VERIFY THAT 
SUCH ATTEMPTS BY USERS IN A STUDENT STATUS WILL BE REJECTED, YOU SHOULD 
ATTEMPT TO INPUT BOTH A "#SAVE" AND A "?SAVE" COMMAND. 

THE SYSTEM WILL RESPOND TO THE #SAVE INPUT WITH THE MESSAGE "ILLEGAL 
USE OF SYMBOL* 1 , INDICATING THAT CDTS WILL NOT PERMIT A STUDENT TO INPUT 
ANY COMMAND PRECEDED BY THE # SYMBOL, WHICH IS RESERVED FOR COURSE 
DESIGNER USE. 

YOUR ATTEMPT TO INPUT A ?SAVE COMMAND WILL BE REJECTED WITH THE 
MESSAGE "UNDEFINED COMMAND/OPTION" INDICATING THAT 7SAVE HAS NO MEANING 
TO THE SYSTEM. 
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(after trying these illegal commands, type "move on" and we will move 
on to examine the use of the save command by the course designer. ) 



?save 

UNDEFINED COMMAND/OPTION 
#8ave 

ILLEGAL STUDENT USE OF # 
MOVE ON 

ONCE AQALN A USER AT ANOTHER REMOTE TERMINAL WILL BE USED To DEMON- 
STRATE THE CAPABILITIES AVAILABLE TO THE CD. WHEN HE HAS ACCESSED A 
DEMONSTRATION LESSON IDENTIFIED AS "DEMO02", HE WILL ATTEMPT THE 
FOLLOWING ACTIONS: 

1 )EXECUTING A "SAVE DONE" COMMAND WHILE HE IS IN THE ROLE OF A 
PSEUDO TRAINEE. THIS MEANS THAT HE WILL EXECUTE A FRAME OR TWO VIA THE 
"EX" COMMAND (WHICH WILL BE EXPLAINED IN DETAIL AT A LATER TIME) AND 
THEN INPUT THE SAVE DONE. 

THIS SITUATION WOULD OCCUR WHEN THE CD HAS ALREADY MODIFIED A LESSON 
THROUGH THE EDITING CAPABILITY, AND HAS EXECUTED SOME PORTION OF IT 

IN ORDER TO THE LOGIC. (TYPE IN A SINGLE LETER 

A VERIFY 
B CHECK OUT 
C SIMPLIFY 

*. 

a 

RIGHT - THE LOGIC AND FLOW OF A CDTS LESSON MUST BE VERIFIED JUST 

AS WITH A COMPUTER PROGRAM. 



WHEN THE CD HAS RECEIVED THE "SAVED" MESSAGE, TYPE IN "SAVED" AT THIS 
TERMINAL AND HE WILL EXECUTE UNDER A SECOND CONDITION. 

saved 
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#get demo02 9z 

061869 

ALLOW TRAINEE ACCESS ?Y/fo 

Y 

ENTER COMMAND 

#ex 89.5 

IN ORDER TO THE LOGIC. (TYPE IN A SINGLE LETTER 

A VERIFY 

B CHECK OUT 

C SIMPLIFY 

*. 

#save 

SAVED 
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2)THE second example of the use of the save command will involve the 

INPUT OF A SAVE DONE COMMAND IMMEDIATELY FOLLOWING A SAVE COMMAND FOB 
THE SAME LESSON. THE PURPOSE OF THIS COMBINATION OF ACTIONS IS To 
DEMONSTRATE THAT CDTS CAN HANDLE THE SITUATION WHERE THE CD 
INADEVERTANTLY INPUTS A SAVE COMMAND WITHOUT THE DONE PARAMETER. 

AFTER THE OUTPUT OF THE 'SAVED' MESSAGE AT THE OTHER TERMINAL, TYPE IN 
•SAVE DONE' AT THIS REMOTE AND WE WILL VERIFY THAT DATA IS INDEED 'SAVED' 
ONTO DISK. 
*. 
save done 

TO VERIFY THAT THE MATERIAL HAS BEEN PROPERLY SAVED, THE CD WILL USE 
THE PRINT COMMAND TO PULL THE NEW AND CHANGED FRAMES OFF OF DISK AND 
DISPLAY THEM AT HIS TERMINAL. 

TYPE IN "DONE" AFTER THE MATERIAL IS PRINTED. 



done 

THE STATUS COMMAND 

THE STATUS COMMAND PERMITS THE COURSE DESIGNER TO DETERMINE THE CURRENT 
CONDITIONAL STATE OF THE OPTIONAL FUNCTIONS: 

PHONETIC 

ORDER 

KEYWORD 



THIS CAN BE VERY USEFUL TO A COURSE DESIGNER EITHER WHEN HE IS BUILD- 
ING A LESSON AND HAS 'LOST' TRACK OF THE STATUS OF THESE SERVICE 



FUNCTIONS OR IS EXECUTING A LESSON AS A PSEUDO TRAINEE AND IS HAVING 
SOME DIFFICULTY IN QUALITY CONTROLLING THE LESSON. 

IN THE LATTER CASE, THE COURSE DESIGNER MAY WISH TO TEST THE CORRECT 
AS WELL AS SEVERAL INCORRECT OR UNANTICIPATED RESPONSES TO SEE THE 
REACTION WITHIN THE PARTICULAR FRAME. DETERMINING THE STATUS OF THE 
PARTICULAR SERVICE FUNCTION ASSISTS THE COURSE DESIGNER IN ESTABLISH- 
ING THE BEST ANSWER PROCESSING CRITERIA FOR A GIVEN FRAME OR SET OF 
FRAMES. 



TO USE THIS COMMAND, THE USER MUST BE A COURSE DESIGNER WHO HAS 
ACCESSED A LESSON. 
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#ex 89.5 

IN ORDER TO THE LOGIC. (TYPE 3N A SIMJLE LETTER 

A VERIFY 

B CHECK OUT 

C SIMPLIFY 

*. 

#save done 

SAVED 

#get demo02 9z 

061869 

ALLOW TRAINEE ACCESS ?Y/N 

Y 

ENTER COMMAND 

#1 91 2 2 

AFTER THE OUTPUT OF THE 'ENTER INITIAL COMMAND 1 MESSAGE AT THE OTHER 

*. 

after the output of the 'saved' message at the other 

DONS 

*. 

#save 
SAVED 

91 2 2 

G.2 TEXT 

2.0 AFTER THE OUTPUT OF THE 'SAVED' MESSAGE AT THE OTHER 
DONE 
*. 

#save done 
SAVED 
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THE COURSE DESIGNER INPUTS: 

#STATUS 
THE PROGRAM READS THE SERVICE FUNCTION TABLE AND OUTPUTS THE CURRENT 
STATUS OF PHONETIC, ORDER, AND KEYWORD. 

THE PROGRAM INDICATES WHETHER THE SERVICE FUNCTION IS 'ON' OR 'OFF 1 , 
BUT DOES NOT INDICATE WHETHER A PARTICULAR SERVICE FUNCTION 
HAS BEEN 'SET* ON. THIS MUST BE DETERMINED BY THE COURSE DESIGNER 
REVIEWING A PRINTOUT OF THE LESSON. 

TO VERIFY THAT THIS COMMAND IS NOT AVAILABLE TO A STUDENT, FIRST TYPE 
/STATUS 

AFTER THIS HAS BEEN DONE AND THE ERROR MESSAGE: 

ILLEGAL STUDENT USE OF # 
HAS BEEN OUTPUT, TYPE IN GO. 

#status 

ILLEGAL STUDENT USE OF # 

GO 

VERY GOOD. 

NOW, INPUT THE COMMAND PRECEDED BY A (QUESTION MARK 

7STATUS 

THIS WILL CAUSE THE ERROR MESSAGE: 

UNDEFINED COMMAND/OPTION 

TO BE OUTPUT. 
AGAIN, AFTER THE ERROR MESSAGE HAS BEEN OUTPUT, TYPE GO 

• 

? status 

UNDEFINED COMMAND/OPTION 

GO 

FINE, LET' MOVE OUT. 

IN THIS CASE, THE PROGRAM ACCEPTS THE USE OF THE QUESTION MARK 

BY THE STUDENT, BUT THE WORD 'STATUS' IS NOT A LEGAL OPTION AND THE 

PROGRAM REJECTS THE INPUT AS ILLEGAL. 
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#status 

PHONETIC-ON , ORDER-OFF ,KEYWORD-OFF 

#ex 55.5 

*. 

#status 

PHONETIC-ON , ORDER-OFF ,KEYW0RD-OFF 

#i 55.5 3 1 

*. 

phonetic off 

DONE 

*. 

#save 

SAVED 

#status 

PHONETIC-OFF , ORDER-OFF ,KEYWORD-OFF 
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RESTART 

*********** 

THE CDTS C0M4AND THAT IS PROBABLY USED THE LEAST BY THE COURSE DESIGNER 
IS THE "RESTART" . THIS COM4AND PERMITS THE DISK SPACE BEING OCCUPIED 
BY AN UNWANTED LESSON TO BE MADE AVAILABLE FOR THE GENERATION OF A NEW 

LESSON. IT ALSO DELETES THE LESSON NAME FROM THE TABLE OF CONTENTS, 
MAKING THE NAME AVAILABLE AT ANY FUTURE TIME. 

TO RESTART A LESSON, THE COURSE DESIGNER NATURALLY MUST HAVE PREVIOUSLY 
ACCESSED THE LESSON THROUGH THE --- COMMAND. 



get 

VERY GOOD, YOU REMEMBERED. 

TO VERIFY THAT THE GET COH4AND IS REQUIRED PRIOR TO THE RESTART, THE 

SYSTEM USER AT THE OTHER TERMINAL WILL ATTEMPT TO RESTART THIS 

LESSON (PEMO02 ) WITHOUT HAVING ACCESS TO IT. 

WHEN THIS ACTION HAS BEEN TAKEN AND THE MESSAGE "ILLEGAL FIRST COMMAND" 
APPEARS, TYPE IN "DONE" AND WE WILL PROCEED TO DEMONSTRATE THE PROPER 
FUNCTIONING OF THE RESTART REQUEST. 

done 

OK. THIS WELL REQUIRE A COUPLE OF ACTIONS FROM YOUR TERMINAL. 



SINCE WE NATURALLY DO NOT WANT TO BLOW Up THIS DEMONSTRATION OF CDTS 
CAPABILITIES, WE CANNOT PERMIT THE SYSTEM USER AT THE OTHER TERMINAL 
TO RESTART THE LESSON YOU ARE EXECUTING. IT WILL BE NECESSARY FOR YOU 
TO GET A LXJM4Y LESSON WHICH HAS BEEN IDENTIFIED AS "DUMflf M . 

THE PROPER SEQUENCE OF ACTIONS TO ACCOMPLISH THIS SWITCH IS: 
A 1 *CLOSE 2 ?GET DUMMY LASTNAME 
B 1 ?QUIT 2 ?GET UMtt LASTNAME 
C 1 *OPEN 2 ?GET DUMMY LASTNAME 
*, 

b 

NEGATIVE 

BEFORE YOU EXECUTE THESE TWO COMMANDS, LET'S OUTLINE WHAT SHOULD OCCUR 

AFTER YOU GET THE "DUM4Y" LESSON. 
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^restart 

ILLEGAL FIRST COMMAND 
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A LINE OF TEXT WILL BE PRINTED, AND THEN THE USER AT THE OTHER 
TERMINAL WILL ALSO GET THE LESSON, AND IDENTIFY HIMSELF AS THE CD, 
USING AN ID OF "DF". ONCE HE HAS ACCESSED THE LESSON HE WILL RESTART 
IT AND TWO ACTIONS WLLL RESULT: 
1 THE COURSE DESIGNER WILL RECEIVE THE MESSAGE "GONE ENTER INITIAL 
COMMAND." 



2) THIS TERMINAL WILL RECEIVE THE MESSAGE "LESSON REMOVED FROM DISK 
BY CD". 



THESE MESSAGES INDICATE TO THE USERS THAT THE LESSON NAME HAS BEEN 
REMOVED FROM THE LESSON FILE TABLE OF CONTENTS, WHICH MEANS THAT IT: 

A CAN NO LONGER BE EXECUTED 

B CAN BE EXECUTED ONLY BY THE COURSE DESIGNER 

•*_ 
a 

CHECK 

TO VERIFY THAT THE LESSON NAME HAS BEEN ELIMINATED FROM THE SYSTEM, YOU 
ARE TO ATTEMPT TO "GET" THE LESSON AGAIN, FOLLOWING THE "LESSON 
REMOVED" MESSAGE. YOU WILL THEN RECEIVE A "LESSON NOT ON DISK" 
INDICATION. 



OK, WE ARE FINALLY READY TO DEMONSTRATE THE RESTART. FIND THE PORTION 
OF YOUR PRINTOUT LABELLED "RESTART" AND EXECUTE THE SEQUENCE OF EVENTS 
BEGINNING WITH THE "?QUIT" COMMAND. WHEN YOU HAVE VERIFIED THAT LESSON 
"DUMMY" IS NOT ON DISK, TYPE "?GET DEMO02 LASTNAME" AND TYPE IN 
"VERIFIED". WE WILL THEN CONSIDER ANOTHER CDTS COMMAND. 

?quit 

ENTER INITIAL COMMAND 
?get dummyl salvage 
061869 

THIS IS FRAME ONE, TYPE TWO 
* w 

two 

LESSON REMOVED FROM DISK BY CD 

?get dumnyl tooley 

LESSON NOT ON DISK 

?get demo02 salvage 
061869 
"VERIFIED". WE WILL THEN CONSIDER ANOTHER CDTS COMMAND. 



270 



#get dunnnyl re 

061869 

ALLOW TRAINEE ACCESS ?Y/N 

Y 

ENTER COMMAND 

#P1 1 

RENAME 1 .0 LABEL= BLURP 

DONE 

*. 

#restart 

GONE, ENTER INITIAL COMMAND 

#get duramyl re 

IZSSON NOT ON DISK 
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verified 

THE EX (EXECUTE) COMMAND 

******** *************** 



THE EX COMMAND IS ANOTHEB COMMAND WHICH IS RESTRICTED TO COURSE 
DESIGNER USE. THE COMMAND PERMITS THE CD TO EXECUTE ANY PORTION OF HIS 

LESSON. HE IS PLACED IN A "PSEUDO TRAINEE" STATUS, RATHER THAN A 
TRAINEE STATUS, WHICH PERMITS HIM A MUCH LARGER DEGREE OF FREEDOM 
DURING EXECUTION. HE CAN INTERRUPT THE SEQUENCE OF FRAMES BEING 

EXECUTED AND CAN EXAMINE THE FUNCTIONING OF AN ENTIRELY UNRELATED SET 
OF FRAMES IF HE SO DESIRES. HE CAN REPEATEDLY EXECUTE THE SAME SET OF 
FRAMES WITH DIFFERENT COMBINATIONS OF RIGHT AND WRONG ANSWERS, IN ORDER 
TO VERIFY THE LESSON LOGIC BEFORE IT IS EXECUTED BY AN ACTUAL. 
A STUDENT 
B TRAINEE 

C OPERATOR 

* # 

b 

RIGHT 

THE FORMAT OF THE EX COMMAND IS SIMPLY "#EX DDD.D", WHERE DDD.D IS AN 

EXISTING FRAME NUMBER WITHIN THE LESSON. 

ONCE AGAIN, YOU CANNOT LEGALLY INPUT THE EX COMMAND FROM THIS TERMINAL, 
DUE TO YOUR "TRAINEE" STATUS. 

TO VERIFY THAT AN ATTEMPT ON YOUR PART TO INPUT AN EX WILL BE 

REJECTED TRY IT. YOU WILL RECEIVE EITHER THE ILLEGAL STUDENT USE OF 

#, OR UNDEFINED COMMAND/OPTION MESSAGE, DEPENDING UPON WHETHER YOU 
PRECEDED THE COMMAND WITH A "#" OR "?". 

AFTER PROVING THAT YOU (AS A STUDENT) CANNOT 'EX', TYPE IN GO 
AND HE SHALL CONSIDER WHAT HAPPENS WHEN THE COURSE DESIGNER 
PROPERLY USES THE COMMAND. 



#ex 30^.5 
ILLEGAL STUDENT USE OF # 

?ex 30^.5 

UNDEFINED COMMAND/OPTION 

GO 

THE COURSE DESIGNER ACTUALLY MUST CONFORM TO TWO SYSTEM RESTRICTIONS, 

OR HIS EX COMMAND WILL ALSO BE CONSIDERED AS BEING ILLEGAL. HE MUST BE 

ASSOCIATED WITH A LESSON (VIA THE GET OR CO COMMANDS) AND MUST ATTEMPT 

TO EXECUTE FRAMES THAT: 
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A ARE L ABELLED 

B HAVE ALL FOUR CROUPS 
C EXIST WITHIN THE LESSON 
* 

c 

TRUE 

THE COURSE DESIGNER AT THE OTHER TERMINAL WILL NOW DEMONSTRATE THESE 
ILLEGAL ACTIONS. HE WILL FIRST ATTEMPT To INPUT THE EX COMMAND WHEN HE 
IS NOT ASSOCIATED WITH A LESSON, WHICH WILL CAUSE A MESSAGE INDICATING 
THAT THIS IS AN "ILLEGAL FIRST COMMAND." 

AFTER HE HAS SUCCESSFULLY ACCESSED THE TEST LESSON, THE CD WILL ATTEMPT 
TO EX A NONEXISTENT FRAME. THIS ACTION WILL RESULT IN THE 'MO SUCH 
FRAME OR LABEL' MESSAGE. (HOPEFULLY THIS IS THE ONLY TIME HE WILL 
SELECT A NON-EXISTANT FRAME. ) 

AFTER THESE TWO ERROR CONDITIONS HAVE BEEN DEMONSTRATED, TYPE IN 
"READY TO EX" AND THE CD WILL DEMONSTRATE THE PROPER USE OF 

THIS COMMAND. 

* 

• 

ready to ex 

OK, LET'S DO IT. 

WHEN THE CD HAS ACCESSED THE LESSON FOR THIS DEMONSTRATION, HE WILL ATTEMPT 

TO EX FRAME 310.0. 

TO DEMONSTRATE CDTS CAPABILITY TO EX FROM A FRAME LABEL, THE CD WILL INPUT 
#EX KEYWOR. 

FOLLOWING THIS DISPLAY, TYPE IN "OK". 

*. 

ok 

OK 

NOW THE CD WILL SELECT HVE NUMBERS AND LABELS FROM THE LISTING OF THE 
LESSON, AND WILL VERIFY THE COMMAND WILL HANDLE ANY LEGAL INPUT. AT ONE 
POINT IN THE SEQUENCE THE SAME FRAME NUMBER WILL BE INPUT TWICE IN A ROW, 
TO PROVE THAT THE PROGRAM CAN HANDLE THAT CONTINGENCY. 
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#ex 310 

ILLEGAL FIRST COMMAND 

#get demo02 $z 

061869 

ALLOW TRAINEE ACCESS?Y/N 

Y 

ENTER COMMAND 

#ex 1.5 

NO SUCH FRAME/LABEL 

#ex 310 

AFTER THESE TWO ERROR CONDITIONS HAVE BEEN DEMONSTRATED, TYPE IN 

"READY TO EX" AND THE CD WILL DEMONSTRATE THE PROPER USE OF 

THIS COMMAND. 

*. 

#ex f363 

THIS IS FRAME 363, WHICH IS AN M FRAME, AND IS LABELED "F363". THIS 

FRAME WILL CONTAIN ONLY THE GROUP TWO, AND WILL BE FOLLOWED BY ANOTHER 

M FRAME CONTAINING ONLY A GROUP TWO. THE TWO FRAMES WILL THEN BE 

FOLLOWED BY AN M FRAME CONTAINING A GROUP 3, BUT HO GROUP 2. 

THIS IS FRAME 36U, WHICH ALSO CONTAINS ONLY A GROUP 2. WHAT DO YOU 
SUPPOSE WE ARE TRYING TO PROVE BY SPLITTING THIS GROUP 2 FROM THE 
GROUP 3 WHICH IS ASSOCIATED WITH IT, BUT APPEARS IN THE NEXT FRAME? 

A THAT ARBITRARY SPLITS OF GROUPS BETWEEN FRAMES CAN BE MADE 

B THAT M FRAMES ARE EASY TO BUILD 

C THAT YOU CAN STILL BUILD M FRAMES WHEN TEXT NEARS THE k00 CHAR. LIMIT 

*. 

#ex 90 

WHEN THE CD HAS RECEIVED THE "SAVED" MESSAGE, TYPE IN "SAVED" AT THIS 

TERMINAL AND HE WILL EXECUTE UNDER A SECOND CONDITION. 

* 

. 

#ex keywor 

KEYWORD— IS THE FUNCTION THAT PERMITS EXTRANEOUS WORDS TO BE 

INPUT, ALONG WITH THE "KEY WORDS" REQUIRED TO DEMONSTRATE KNOWLEDGE OF 
THE TOPIC. THE PROGRAM IGNORES EVERYTHING IN THE RESPONSE EXCEPT THOSE 
KEY WHICH ARE SPECIFIED TO BE MATCHED. 
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TYPE IN ANY RESPONSE THAT COMES TO MIND WHEN THIS SEQUENCE HAS BEEN 
COMPLETED, AND WE WILL PROCEED. 



ate 

OK ONE MORE EXAMPLE OF THE EX. 

AS MENTIONED PREVIOUSLY, THE PURPOSE OF THE EX COMMAND IS TO PERMIT THE 
CD TO EXECUTE HIS LESSON AND VERIFY THE LOGIC IF HE HAD JUST BEEN 
CONSTRUCTING OR MODIFYING FRAMES AND WISHED TO EXECUTE THEM, HE WOULD 

FIRST UPDATE THE SYSTEM TABLES ON DISK STORAGE VIA THE S-— COMMAND 

* 

save 

RIGHT 

THE CD AT THE OTHER TERMINAL WILL INPUT A SAVE COMMAND, AS IF HE HAS 

JUST FINISHED LESSON BUILDING, AND THEN WELL PROVE THAT HE CAN 
IMMEDIATELY ENTER THE EX COMMAND FOR THE SAME LESSON. (TYPE IN "THRU" 

AFTERWARDS. ) 

* 

thru 

THIS CONCLUDES THE CDTS EX COMMAND. THE NEXT SYSTEM FUNCTION WE WILL 
COVER IS THE EXECUTION MODE ITSELF. IF YOU WOULD RATHER BREAK FOR NOW 
OTHERWISE TYPE "GO ON" AND WE'LL CONSIDER LESSON EXECUTION. 

AND CONTINUE LATER, TYPE IN ?QUIT AND WE'LL PICK UP AT THIS POINT. 

* 

. 

go on 

THE MAJOR FEATURES OF THIS MODE ARE 

-TRAINEE CONTROL OVER THE PRESENTATION RATE OF COURSE MATERIAL, 
SUBJECT TO THE CONSTRAINTS OF THE MCP, DCH, AND THE INTENT OF 
THE COURSE DESIGNERS. 

-SERVICE FUNCTIONS (PHONETIC COMPARISON, KEYWORD MATCH. AND/OR ORDER 
PERMUTATION) TO PROVIDE LATITUDES IN EVALUATING TRAINEE ANSWERS THAT 
DO NOT IDENTICALLY MATCH ANTICIPATED RESPONSES 

-AUTOMATIC EVALUATION OF THE TRAINEE RESPONSES 

-IMMEDIATE FEEDBACK, IF REQUIRED, TO THE TRAINEE AFTER HIS RESPONSE 



-DETECTION OF ILLEGAL ACTIONS BY THE TRAINEE 

-DYNAMIC SEQUENCING OF COURSE MATERIAL RESULTING FROM TRAINEE 
RESPONSES AND COURSE DESIGNER INTENT 

-LESSON CONTINUATION FROM THE APPROPRIATE POINT IF A LESSON IS 
INTERRUPTED PRIOR TO COMPLETION 



•CREATION OF TRAINEE PERFORMANCE RECORDS 
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#ex 378.5 

LET'S SLOW DOWN A BIT AND CHECK ON BOTH OF THOSE DECISION STATEMENTS. 

(TYPE OK WHEN YOU'RE READY FOR THE NEXT-ONE) 

*. 

#ex 90 

WHEN THE CD HAS RECEIVED THE "SAVED" MESSAGE, TYPE IN "SAVED" AT THIS 

TERMINAL AND HE WILL EXECUTE UNDER A SECOND CONDITION. 

*. 

#ex 603 

HAVING DUPLICATE ANSWER TAGS— WHICH COULD INDICATE THAT THE COURSE 

DESIGNER WISHES TO HAVE MORE THAN ONE ANSWER TREATED THE SAME BY THE 

PROGRAM. FOR EXAMPLE, PLEASE INPUT THE NUMBER OF THE GROUP THAT IS USED 

TO PRESENT TEXTUAL MATERIAL WITHIN A »Q» FRAME 

* 

#save 

SAVED 

#ex603 

HAVING DUPLICATE ANSWER TAGS— WHICH COULD INDICATE THAT THE COURSE 

DESIGNER WISHES TO HAVE MORE THAN ONE ANSWER TREATED THE SAME BY THE 

PROGRAM. FOR EXAMPLE, PLEASE INPUT THE NUMBER OF THE GROUP THAT IS USED 

TO PRESENT TEXTUAL MATERIAL WITHIN A 'Q' FRAME 

*. 

#save done 

SAVED 

#ex 603 

ILLEGAL FIRST COMMAND 



End of Day 3 Formal Qualification Testing 
Course Designer 
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THE LESSON EXECUTION FUNCTION STEPS SEQUENTIALLY FROM FRAME TO FRAME, 
UNLESS A BRANCH IS ENCOUNTERED. THE FUNCTION REQUIRES THAT A GROUP 1 
BEGIN EACH FRAME, BUT WELL HANDLE ANY LEGAL COMBINATION OF THE OTHER 

TYPES OF GROUPS. 

A TWO 
B THREE 

C FOUR 

*. 

b 

CORRECT 

GROUP 1 PROCESSING INVOLVES THE DETERMINATION OF FRAME TYPE AND THE 

SETTING OF CONTROLS FOR THE PROCESSING OF SUBSEQUENT GROUPS. 

THE FOLLOWING CONDITIONS WILL BE SET UP TO VERIFY THE PROPER PROCESSING 

OF THE GROUP 1 : 

1 )AT LEAST THREE OCCURENCES OF EACH OF THE LEGAL FRAME TYPES, 
IN RANDOM ORDER. 

2) AT LEAST ONE LABELED FRAME FOR EACH FRAME TYPE. 

3)ONE OCCURRENCE OF A FRAME CONTAINING ONLY A GROUP ONE. 



WITH THE EXCEPTION OF THE THIRD CONDITION, IT DOES NOT REALLY MAKE 
SENSE TO ATTEMPT TO TEST THE FUNCTIONING OF THE GROUP 1 ALL BY ITSELF, 
SO WE WILL VERIFY THE PROCESSING OF THE GROUPS 1 AND 2 TOGETHER. 
IF YOU RECALL, THE GROUP TWO MERELY INVOLVES THE PRINTING OF TEXTUAL 

MATERIAL FOR TWO FRAME TYPES WHICH ARE: 

A Q AND D 
B Q AND M 
C D AND M 
* # 

b 

RIGHT - THE Q AND M FRAMES USE THE GROUP 2 TO PRINT TEXT 

THE REACTIONS WE ARE ABOUT TO VERIFY ARE THAT: 

1 )THE CONTENTS OF EACH GROUP 2 ARE PRINTED PROPERLY. THIS WILL BE 
VERIFIED BY EXAMINING THE LISTING OF THIS LESSON FOR FRAMES 359 
THROUGH 36U. 



2)THE PROPER PRINTING OF SUCCESSIVE FRAMES CONTAINING ONLY GROUPS 
ONE AND TWO. 

3)THE FACT THAT THE GROUP 3 ANSWER CHOICES PRINT FOR M FRAMES, RATHER 
THAN THE OUTPUT STOPPING WITH THE GROUP 2. 
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THIS IS ALSO A q FRAME, HAVING h00 CHARACTERS OF DATA (THE LIMIT FOR 

ANY FRAME. ) THE PURPOSE OF THIS FRAME IS To DEMONSTRATE THAT SUCCESSIVE 
FRAMES MAY CONTAIN JUST GROUPS 1 AND 2, AND THAT THE LENGTH OF THE 
GROUPS MAY VARY, UP TO A MAXIMUM LENGTH OF k00 CHARACTERS OF DATA 
(INCL. CDTS CONTROL INFORMATION.) 

THIS IS FRAME 363, WHICH IS AN M FRAME, AND IS LABELED "F363". THIS 
FRAME .JILL CONTAIN ONLY THE GROUP TWO, AND WILL BE FOLLOWED BY ANOTHER 
M FRAME CONTAINING ONLY A GROUP TWO. THE TWO FRAMES WILL THEN BE 
FOLLOWED BY AN M FRAME CONTAINING A GROUP 3, BUT NO GROUP 2. 

THIS IS FRAME 36k , WHICH ALSO CONTAINS ONLY A GROUP 2. WHAT DO YOU 
SUPPOSE WE ARE TRYING TO PROVE BY SPLITTING THIS GROUP 2 FROM THE 
GROUP 3 WHICH IS ASSOCIATED WITH IT, BUT APPEARS IN THE NEXT FRAME? 

A THAT ARBITRARY SPLITS OF GROUPS BETWEEN FRAMES CAN BE MADE 

B THAT M FRAMES ARE EASY TO BUILD 
C THAT YOU CAN STILL BUILD M FRAMES WHEN TEXT NEARS THE k00 CHAR. LIMIT 

* 

. 

c 

YES 

BY LOOKING AT THE LISTING OF FRAMES 363-365 OF THIS LESSON YOU WILL oEE 
THAT THE TWO GROUP TWOS AND THE GROUP THREE ANSWER CHOICES WERE ALL 
PRESENTED AS IF THEY WERE CONTAINED WITHIN A SINGLE FRAME. 

NOW LET'S CONSIDER THE GROUP TWO PROCESSING FQR THE OTHER TYPE OF 
FRAfrffi WITHIN CDTS, WHICH IS THE "D", MEANING FRAME. 

* 

decision 
GOOD 

THE GROUP 2 WITHIN THE D FRAME CONTAINS ALL THE DATA FOR DECISION 
MAKING. THUS THERE ARE NO GROUP THREES OR FOURS ASSOCIATED WITH THE 
D FRAME. WITHIN THE GROUP THE CD CAN EVALUATE A SERIES OF TRAINEE 
RESPONSES; TEST ITEM VALUES SET IN PREVIOUS FRAMES; AND SPECIFY 
FEEDBACK AND BRANCHES BASED UPON WHETHER OR NOT THE CONDITIONS HE HAS 
SET UP ARE MET. 

TO VERIFY THE D FRAME PROCESSING, YOU WILL BE PRESENTED WITH A SERIES 
OF FRAMES WHICH WILL INSTRUCT YOU AS TO WHAT ANSWERS ARE TO BE INSER- 
TED. FOLLOWING THESE FRAMES WILL BE A SET OF DECISION FRAMES tfttCH WILL 
DEMONSTRATE THE FUNCTIONING AND POWER OF THIS FRAME TYPE. 

BY COMPARING YOUR RESPONSES WITH THE LESSON LISTING, YOU WILL BE 

ABLE TO VERIFY THE DECISION LOGIC. ALONG THE WAY WE WILL ALSO VALIDATE 

THAT ILLEGAL DECISION STATEMENTS ARE REJECTED AND ERRORS FLAGGED. 
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(FRAME 371 TYPE IN THE CORRECT ANSWER) 

CDTS STANDS FOR COMPUTER DIRECTED SUBSYSTEM 

A TECHNICAL 
B TRAINING 
C TELEVISION 

b 

TRUE 

(FRAME 372 TYPE IN THE CORRECT ANSWER) 

THE INDIVIDUAL WHO CONSTRUCTS CDTS LESSONS IS TERMED A : 

A COURSE DESIGNER 

B CONSTRUCTION SUPERVISOR 

*. 

a 

CORRECT 

(FRAME 373 TYPE IN THE CORRECT ANSWER) 

CDTS IS DESIGNED TO BECOME AN INTEGRAL PART OF: 
A THE CIVIL ENGINEERING SYSTEM 
B THE BASE LEVEL SYSTEM 
* # 

b 

FINE 

(FRAME 3' 'k TYPE IN THE INCORRECT ANSWER AND THEN FOLLOW IT WITH THE 

CORRECT ANSWER) WHAT MODE OF CDTS IS USED TO CONSTRUCT LESSONS? 

A LESSON EXECUTION 
B LESSON BUILDING 

a 

WRONGLY AGAIN 

* 

b 

VERY GOOD (IF THIS IS YOUR SCOW) RESPONSE) 

(FRAME 375 TYPE IN ANY INCORRECT ANSWER) 

A CDTS U2SSON REQUIRES THOUSAND BYTES OF DISK STORAGE? 

* # 

IT'S 121,000 BYTES, BUT THAT'S OK. 

THAT CONCLUDES OUR SEQUENCE FOR DECISION FRAME VERIFICATION. YOU SHOULD 

HAVE A RECORD LIKE THIS: 

371 + 

372 + 

3Y3 + 

37U 

37 1 * + 

375 
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FRAME 377 WILL DETERMINE' IF ALL THREE OF FRAMES 371-373 WERE 

ANSWERED CORRECTLY. 

GOOD, YOU GOT THEM ALL. 

FRAME 3 r8 WILL EXERCISE THE "WRONG" TEST, SINCE YOU SHOULD HAVE 

MISSED BOTH FRAMES 37k AND 375. 

SOMEHOW YOU GOT EITHER 37 1 * OR 3^5 RIGHT. 

LET'S SLOW DOWN A BIT AND CHECK ON BOTH OF THOSE DECISION S\ ATEMENTS. 

(TYPE OK WHEN YOU'RE READY FOR THE NEXT ONE) 

ok 

OK, NOW FOR TWO MORE DECISIONS. 

FRAME 379 WILL DETERMINE IF THE LAST RESPONSE TO FRAMES 3/1.371+ WERE 

CORRECT (SINCE YOU SHOULD HAVE GOTTEN 3lk RIGHT ON THE SECOND TRY). 

GOOD, YOU DID IT AGAIN. 

FRAME 380 WILL TEST THE "ALL RIGHT" CAPABILITY (WHICH YOU DIDN'T DO). 

OK, YOU DIDN'T GET THEM ALL RIGHT. 

AFTER YOU HAVE EXAMINED THE PROCESSING OF "LAST RIGHT" AND "ALL RIGHT", 

WE'LL TRY OTHER VARIATIONS. AS YOU CAN SEE, FRAME 3 >k QUALIFIES FOR 

"LAST RIGHT" SINCE THE LAST RESPONSE WAS CORRECT, BUT IT DOES NOT 

QUALIFY FOR "ALL RIGHT", WHICH PERMITS NO WRONG ANSWERS AT ALL. 

TYPE OK WHEN OK 



ok 

FRAME 381 WILL DEMONSTRATE THE COMPOUND STATEMENT, LOOKING FOR RIGHT 
ANSWERS TO FRAMES 371-3 '2 AND A WRONG ANSWER TO FRAME 375. 
YOU GOT THE RIGHT TWO. 

FRAME 382 WILL TEST THE COMPOUND STATEMENT INVOLVING AN "OR" CON- 
DITION, LOOKING FOR 1 OR MORE RIGHT OR LESS THAN 3 WRONG. 
IMPOSSIBLE 

NOW LET'S EXAMINE THE CAPABILITY OF DETERMINING IF THE STUDENT INSERTED 
SPECIFIC ANSWER TAGS. IF INSTRUCTIONS WERE FOLLOWED FOR FRAMES 371 -37^, 

YOU INSERTED "B" FOR 371, "A" FOR 3 (2, "B" FOR 373 AND "A" FOR 37 1 *. 
FRAME 38U WILL BE A COMPOUND DECISION STATEMENT, LOOKING FOR THESE 
VALUES. 

you didn't follow instructions, we still have verified 
this type of processing, however, since you didn't branch to 38u.5 
excellent. you answered properly, and were therefore branched to 
this frame (38u.5) 

the last type of decision frame processing to be verified is the area 
of setting and evaluating items. to demonstrate this we will go through 
three simple decision statements, each of which sets an item. the 
fourth decision in the sequence will look for any two of the three 

TO BE SET. 
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IF YOU WISH TO PAUSE AT THIS POINT SO YOU CAN REVIEW THE VARIOUS 
PATHS THROUGH THE PREVIOUS DECISION STATEMENTS, TYPE HALT. IF YOU 

WISH TO (30 ON TYPE CONTINUE. 

* 

continue 

HERE WE GO. 

ITEM! IS NOW SET TO 1. 
ITEM2 IS NOW SET TO 1. 
ITEM3 IS NOW SET TO 1. 

WE WILL NOW TEST FOR VALUES OF 1 FOR ANY COMBINATION OF ITEMS 1, 2, 
AND 3. 

SINCE THE BRANCH TO THIS FRAME (389) WAS TAKEN, YOU MUST HAVE PROPERLY 
EXECUTED THE FRAMES IN QUESTION. 

WE HAVE EXAMINED MANY OF THE ASPECTS OF USING DECISION FRAMES IN A 
LEGAL MANNER. THERE ARE MANY WAYS OF FORMATTING DECISION STATEMENTS 
WHICH DO NOT ENTIRELY CONFORM TO SYSTEM RESTRICTIONS, BUT CONTAIN 
ERRORS WHICH CANNOT BE DETECTED BY THE LESSON BUILDING FUNCTION. 

THE NEXT THREE FRAMES CONTAIN ERRORS IN FORMAT, AND WILL RESULT IN THE 
OUTPUT OF THE MESSAGE "ILLEGAL DECISION STATEMENT 

CONTINUE? YES/NO"- YOU ARE TO ANSWER YES, OF 
COURSE, SO THAT THE TEST MAY CONTINUE. ( IN AN OPERATIONAL ENVIRONMENT 
THE STUDENT WOULD BE INSTRUCTED TO CONTACT HIS TRAINING SUPERVISOR 
BEFORE CONTINUING. THIS FIRST EXAMPLE WILL BEGIN THE LINE WITH A PROPER 
DECISION STATEMENT, BUT WILL BE FOLLOWED BY AN "ELSE" CONDITION WITHOUT 
SPECIFYING THE ACTION TO BE TAKEN FOR THE FIRST CONDITION. 

THIS NEXT EXAMPLE OF AN ILLEGAL DECISION FRAME WILL INVOLVE A BRANCH 
THAT DOES NOT CONFORM TO SYSTEM RESTRICTIONS HERE THE BRANCH WILL BE 
ATTEMPTED TO A NONEXISTANT FRAME NUMBER, RESULTING IN THE OUTPUT OF THE 
MESSAGE " ILLE GAL BRANCH - CONTINUE? YES NO" 

(THE EXACT FORMAT OF THE FRAME IS: 'IF LAST RIGHT 350 B 9.9?.9' ) 

ANOTHER AREA IN WHICH THE COURSE DESIGNER CAN GET IN TROUBLE IS WITH 
THE FORMAT OF ITEM STATEMENTS, WHICH CAN BE BOTH SET UP AND TESTED WITH 
THE D FRAME. WE SHALL ATTEMPT TO DEMONSTRATE FOUR EXAMPLES OF ILLEGAL 
ITEM STATEMENTS WITHIN DECISION FRAMES, CONSTRUCTED THUSLY: 

IF ITEM50 EQ 5 B:100 (ILLEGAL ITEM NAME) 

IF ITEM1 EQ 1 $-. ITEM1 = 1000 (ILLEGAL ITEM VALUE) 

IF ITEM10 EQ ITEM20 F:GOGD (ITEM20 IS AN ILLEGAL VALUE FOR AN ITEM) 

#:ITEM1= ITEM+1 (ILLEGAL ITEM NAME) 

TYPE YES TO CONTINUE AFTER EACH MESSAGE 
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ILLEGAL ITEM NAME 39^.0 2 1.0 

CONTINUE? TYPE YES/NO. 

yes 

ILLEGAL DECISION STATEMENT 39^.2 2 1.0 

CONTINUE? TYPE YES/No. 
yes 

ILLEGAL ITEM NAME 39^.3 2 1.0 
CONTINUE? TYPE YES/NO. 
yes 

THE LAST EXAMPLE OF IMPROPER USE OF DECISION FRAMES INVOLVES "DECISION 
FRAME INDICATORS. EACH FRAME THE CD WANTS TO USE WITHIN A DECISION 
FRAME MUST HAVE A FLAG "l" INPUT IMMEDIATELY FOLLOWING THE FRAME TYPE 
IN THE GROUP 1 . IF A FRAME IS NOT FLAGGED, THE TRAINEE RESPONSES 
WILL NOT BE SAVED FOR LATER EXAMINATION BY THE D FRAME. TO ILLUSTRATE 
THIS, WE WILL ATTEMPT TO MAKE A DECISION BASED SOLELY UPON YOUR 
RESPONSE TO THIS FRAME, WHICH HAS NOT BEEN FLAGGED. (ANSWER "A") 
A IT WILL WORK 
B IT WONT WORK 

b 

OK, THIS D FRAME WILL FEEDBACK "VERY GOOD, YOU FOLLOWED INSTRUCTIONS" 
IF IT DETERMINES THAT THE PREVIOUS FRAME RECEIVED AN "A" ANSWER. 
SORRY, FRAME 395 WAS NOT FLAGGED. 

NOW FOR FURTHER PROOF WE WILL DUPLICATE THIS TEST FOLLOWING THIS FRAME, 
WHICH AS YOU CAN SEE BY THE LISTING, HAS BEEN FLAGGED (ANSWER "A") 
A IT WILL WORK 
B IT WON'T WORK. 



THIS TIME YOU SHOULD GET THE "VERY GOOD" FEEDBACK. 
VERY GOOD. YOU FOLLOWED INSTRUCTIONS 

THIS CONCLUDES THE UEMONSTKATION (JF DECISION FRAME PROCESSING, WHICH 
LEADS TO CUNSIDiSRATION UF THE GROUPS 3 AND 4 FOR THE Q AND M FRAMES. 
IF HOW SEMS TO BE A GOOD TIME TO BREAK, TYPE ?QUIT AND WE WILL DO SO. 
OTHERWISE TYPE IN CONTINUE. 



continue 
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GROUP 3 - Q FRAME 



THE GROUP 3 PROCESSING FOR THE Q FRAME INVOLVES THE EVALUATION OF EACH 
RESPONSE INSERTED BY THE TRAINEE, AND AN ATTEMPT TO MATCH THE RESPONSE 
WITH SPECIFIED CORRECT AND INCORRECT ANSWERS. 

DURING THE EVALUATION OF THE GROUP 3 WE WILL WORK WITH SEVERAL COMBI- 
NATIONS OF THE SERVICE FUNCTIONS KEYWORD, ORDER, AND PHONETIC BEING ON 
AND OFF, DUPLICATE ANSWER TAOS, NO CORRECT ANSWERS SPECIFIED, SPLIT 
FRAMES, AND VARIATIONS OF INSERTED ANSWERS. 



SINCE THE GROUP k PROCESSING IS TO BE VERIFIED AT A LATER TIME, THE 
GROUP FOURS FOR THESE FRAMES WILL BE AS SIMPLE AS POSSIBLE, AND 
NORMALLY WILL JUST BE USED TO GIVE FEEDBACK THAT THE PROPER ANSWER 
MATCH HAS OCCURRED. THE FIRST DEMONSTRATION WILL INVOLVE A FRAME 
HAVING DUPLICATE ANSWER TAOS— WHICH COULD INDICATE THAT THE COURSE 

DESIGNER WISHES TO HAVE MOKE THAN ONE ANSWER TREATED THE SAME BY THE 
PROGRAM. FOR EXAMPLE, PLEASE INPUT THE NUMBER OF THE GROUP THAT IS USED 

TO PRESENT TEXTUAL MATERIAL WITHIN A 'Q' FRAME 

* 

two 

RIGHT TWO OR 2 

FROM THE LESSON LISTING YOU CAN SEE THAT BOTH TWO AND 2 WERE GIVEN AN 
•A' ANSWER TAG AND ARE CONSIDERED TO BE EXACTLY THE SAME 

NEXT WE WILL SEE FRAMES WITH DIFFERENT NUMBERS OF ANSWERS TAGGED AS 

BEING CORRECT, TO PROVE THAT CDTS WILL HANDLE VARYING COMBINATIONS OF 
RIGHT AND WRONG ANSWERS. THIS FRAME (605) HAS NO CORRECT ANSWERS. 

WHAT IS THE EXACT CORE STORAGE REQUIRED BY CDTS? 

* 

• 

who knows 

NO 

THE NEXT FRAME (607) CONTAINS WHAT MIGHT BE CONSIDERED AS A "NORMAL H 

MIX OF ANSWERS TAGGED AS BEING CORRECT AND INCORRECT, AND LOOKS LIKE: 
A+PLUS 
A++ 
B DOLLAR SIGN 

B $ 
C ( 
D BLANK 
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1 WHAT CHARACTER IS USED BY CDTS TO FLAG CORRECT ANSWERS WITHIN THE GROUP 
* THREE? 

* # 

plus 

TRUE 

IF YOU WILL RECALL, IT WAS BROUGHT OUT DURING THE DISCUSSION OF GROUP 

TWO PROCESSING THAT THE GROUPS 1 , 3, AND k THAT ARE ASSOCIATED TOGETHER 

MAY BE SPLIT BETWEEN FRAMES, IF REQUIRED BY THE AMOUNT OF DATA. 

LET'S DEMONSTRATE AGAIN THAT THE PROGRAM WILL AUTOMATICALLY MOVE TO THE 
NEXT NUMBERED FRAME IN SEARCH OF A GROUP THREE. IT WILL CONTINUE 
TO PRINT TEXT UNTIL A GROUP 3 IS FINALLY ENCOUNTERED, AT WHICH TIME 
SOME KIND OF ANSWER MUST BE INSERTED TO CONTINUE. 

THIS FRAME WILL BE FOLLOWED BY FRAME 609, WHICH HAS THE GROUPS 3 AND k. 
(TYPE IN "I UNDERSTAND") 



1 understand 

GOOD, THIS IS AN IMPORTANT CONCEPT. 



KEYWORD, PHONETIC AND ORDER 

** * ***#<■* **** ************* • 



WHEN DISCUSSING THE CONSTRUCTION OF THE GROUP 3 DURING THE LESSON 
BUILDING SECTION OF THE DEMONSTRATION, WE VERY BRIEFLY MENTIONED THE 
CDTS SERVICE FUNCTIONS OF KEYWORD, PHONETIC AND ORDER. 

THESE FUNCTIONS MAY BE SET ON OR OFF, AT COURSE DESIGNER OPTION, TO 
DIRECT THE PROGRAM TO ACCEPT RESPONSES BY THE STUDENT WHICH ARE LESS 
THAN "PERFECT". THE STUDENT MAY RECEIVE CREDIT FOR PROPERLY ANSWERING A 
QUESTION WHEN HE UNDERSTANDS THE CONCEPTS, BUT: 

1 )PUTS IN A SEQUENCE OF CORRECT ANSWERS, BUT NOT IN ORDER 

2)INPUTS THE CORRECT ANSWER, BUT /CDS AN EXTRA WORD OR WORDS 



3)DOESN'T SPELL OR TYPE TOO WELL 
lOHAS ALL OF THE ABOVE PROBLEMS 
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IN ADDITION, VARIOUS COMBINATIONS OF THE FUNCTIONS BEING SET ON CAN 

RELIEVE THE CD OF THE RESPONSIBILITY (AND TIMS CONSUMING PROCESS) OF 
DETERMINING AND INPUTTING EVERY REASONABLY CORRECT TO A QUESTION 

# # 

answer 
OK 

KEYWORD IS THE FUNCTION THAT PERMITS EXTRANEOUS WORDS TO BE 

INPUT, ALONG WITH THE "KEY WORDS" REQUIRED TO DEMONSTRATE KNOWLEDGE OF 
THE TOPIC. THE PROGRAM IGNORES EVERYTHING IN THE RESPONSE EXCEPT THOSE 
KEY WHICH ARE SPECIFIED TO BE MATCHED. 



words 

TRUE 

THE PROGRAM WILL, OF COURSE, USE THE KEYWORD TECHNIQUE TO EVALUATE ALL 

ANSWERS WITHIN THE FRAME, WHETHER TAGGED AS CORRECT ANSWERS OR NOT. THE 

CD MUST HAVE BEEN CAREFUL IN USING KEYWORD. IF HE HAS SPECIFIED AN 

INCORRECT ANSWER WHICH HAS KEYWORDS THAT ALSO APPEAR IN THE CORRECT 

ANSWER THE ORDER OF THE ANSWERS IS CRITICAL. 

FOR EXAMPLE: 

THE NEXT FRAME (617) WILL CONTAIN THE FOLLOWING GROUP 3: 

KEYWORD ON 

A+COMPUTER DIRECTED TRAINING SUBSYSTEM 

B COMPUTER TRAINING 

TYPE IN SOMETHING LIKE "I THINK IT IS COMPUTER DIRECTED TRAINING SUB- 
SYSTEM" 



WHAT DOES CDTS STAND FOR? 

* 

probably stands for computer subsystem straing training 
NOT QUITE - COMPUTER TRAINING ? 



directed subsystem 

NOW THE NEXT FRAME (619) WILL REVERSE THE ORDER OF THE TWO SPECIFIED 
ANSWERS, TYPE IN THE CORRECT ANSWER EXACTLY RIGHT AND YOU WILL SEE THAT 
THE INCORRECT ANSWER IS MATCHED. THIS IS BECAUSE THE PROGRAM QJITS THE 
ANSWER MATCHING PROCESS AS SOON AS THE TRAINEE ANSWER IS MATCHED WITH 
THE KEYWORDS WITHIN A LESSON ANSWER. 

WHAT DOES CDTS STAND FOR? 

* 

computer directed training subsystem 
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NOT i^JITE - YOU OMITTED THE POINT THAT IT COMPUTER 'DIRECTED'. 
NOW LET'S CONSIDER —ORDER- 



ORDER IS THE FUNCTION THAT PERMITS THE TRAINEE RESPONSES TO BE COUNTED 
AS CORRECT WHEN THE SEQUENCE OF WORDS IS UNIMPORTANT. THE PROGRAM 
WILL TAKE EACH WORD OF A TRAINEE ANSWER AND SEARCH THE FIRST LESSON 
ANSWER FOR IT. THIS PROCESS REPEATS UNTIL EACH WORD WITHIN 2638 85 
TRAINEE AND LESSON ANSWER HAS BEEN EXAMINED. IF THERE IS A ONE-FOR-ONE 
MATCH, REGARDLESS OF ORDER, THE LESSON ANSWER IS CONSIDERED MATCHED. IF 
NOT THE NEXT LESSON ANSWER IS EXAMINED IN THE SAME MANNER. 

AS WITH THE KEYWORD FUNCTION, EACH LESSON ANSWER IS EVALUATED IN THE 
SAME MANNER, WHETHER TAGGED AS RIGHT OR WRONG. 

TO SUMMARIZE 'ORDER' PROCESSING - EACH WORD WITHIN AN INSERTED RESPONSE 

MUST MATCH EACH WORD OF A LESSON ANSWER, INDEPENDENT OF THE ORDER OF 
WORDS WITHIN: 
A THE LESSON ANSWER 
B THE TRAINEE ANSWER 

C EITHER ANSWER 

# 

c 

THE CORRECT ANSWER IS EITHER ANSWER 
OK, LET'T SEE SOME EXAMPLES OF ORDER 



HERE'S A SIMPLE ONE. NAME THE TWO SERVICE FUNCTIONS WE HAVE CONSIDERED 
SO FAR, (INPUT THEM BOTH ON ONE LINE WITH ONE SPACE BETWEEN EACH NAME) 
# # 

keyword order 

GOCD, KEYWORD ORDER, OR ORDER KEYWORD. 
IF YOU HAPPENED TO INPUT THE SEQUENCE, 'KEYWORD ORDER*, YOU SPECIFIED 
THE SAME SEQUENCE IHAT IS IN THE FRAME, AND DIDN'T REALLY DEMONSTRATE 
THE FUNCTIONING OF ORDER. IF THIS THE CASE, TYPE 'YES f AND WE'LL TRY 
IT AGAIN THE OTHER WAY (ORDER KEYWORD )OTHERWISE TYPE "PROVEN" 



yea 

HERE'S A SIMPLE ONE. NAME THE TWO SERVICE FUNCTIONS WE HAVE CONSIDERED 

SO FAR. (INPUT THEM BOTH ON ONE LINE WITH ONE SPACE BETWEEN EACH NAME) 

order keyvorshd 

OOCD, KEYWORD ORDER, OR ORDER KEYWORD. 
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KEYWORD AND ORDER ON 

******************** 



NOW TO CONSIDER THE POWER OF HAVING BOTH OF THE KEYWORD AND ORDER 
FUNCTIONS ON. 

THE LOGIC OF BOTH FUNCTIONS OPERATING TOGETHER IS REALLY tJJITE SIMPLE. 
TO BE MATCHED BY A TRAINEE RESPONSE, EACH KEYWORD WITHIN A LESSON 

ANSWER MUST APPEAR IN HIS RESPONSE, BUT INDEPENDENT OF ANY ORDER. IN 
ADDITION, THE TRAINEE RESPONSE MAY CONTAIN EXTRANEOUS WORDS, WHICH WILL 

BE IGNORED BY THE MATCHING PROCESS. 

FOR EXAMPLE, TYPE IN THE NAME OF THE THREE SERVICE FUNCTIONS, 
KEYWORD, ORDER, AND PHONETIC, ALL ON ONE LINE, WITH ONE BLANK BETWEEN 

EACH NAME. USE THE WORDS FUNCTION, SERVICE FUNCTION, OR ANY OTHER EXTRA 
WORDS IN YOUR ANSWER. 

* 

. 

keyword on order on function set phonetic 
CHECK 

THE PHONETIC ENCODING PROCESS 

***************************** 



THE PHONETIC SERVICE FUNCTION PERMITS THE STUDENT TO RECEIVE CREDIT FOR 
ANSWERS, EVEN WHEN SLIGHTLY MISPELLED. THE PROGRAM ENCODES BOTH THE 
INSERTED ANSWER AND EACH LESSON ANSWER, PRIOR TO ATTEMPTING TO MATCH 
THEM. THE PHONETIC ENCODING PROCESS IS ACCOMPLISHED IN FOUR STEPS, AS 
FOLLOWS: 

STEP 1 - LETTER EQUIVALENT 

ALL LETTERS ARE TRANSFORMED INTO THEIR LETTER EQUIVALENTS: 
ORIGINAL LETTER— ABCDEFGHIJKLMNOPQRSTUVWXYZ 
LETTER EQUIVALENT- ABCDABCHACCLMMABCRCDABHCAC 

STEP 2 - THE H REPLACEMENT 

EACH H IN THE WORD IS TRANSFORMED TO THE PRECEDING LETTER 
UNLESS THE H IS THE FIRST LETTER. 

STEP 3 - ELIMINATION OF SUCCESSIVE IDENTICAL CONSONANTS 

ALL BUT THE FIRST LETTER OF AN UNINTERRUPTED SEQUENCE OF 
CONSONANTS ARE ELIMINATED. 

STEP k - ELIMINATION OF ALL A 1 S 
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ALL VOWELS, TRANSFORMED INTO A'S ARE ELIMINATED AND THE FINAL WORD 
CONTAINS ONLY CONSONANTS. 

AS A MATTER OF NECESSITY, THE PROGRAM PHONETICALLY ENCODES THE TRAINEE 
RESPONSE FIRST, SAVES BOTH THE ORIGINAL AND ENCODED FORMS OF HIS RE- 
SPONSE, AND THEN BEGINS ENCODING OF THE LESSON ANSWERS. THE REASON THE 
ORIGINAL FORM OF THE TRAINEE RESPONSE IS SAVED IS: 
A HIS ANSWER MAY MATCH WITHOUT THE NEED FOR PHONETIC ENCODING 
B THE CD CAN TURN PHONETIC OFF LATER IN THE FRAME 
* 

a 

THIS MAY BE TRUE, BUT IS REALLY A VERY MINOR POINT. 

AS A MATER OF EFFICIENCY, THERE IS ALSO ANOTHER OPTION WITHIN THE 
ENCODING PROCESS - THE PROGRAM COULD ENCODE EVERY LESSON ANSWER BEFORE 
ATTEMPTING TO MATCH THE TRAINEE ANSWER, OR COULD ENCODE LESSON ANSWERS 
ONE AT A TIME, ATTEMPTING TO MATCH THE FIRST BEFORE ENCODING THE 
SECOND. 

WHICH TECHNIQUE WOULD YOU THINK THE PROGRAM SHOULD USE? 
A ENCODE EACH ANSWER JUST BEFORE ATTEMPTING THE MATCH 
B ENCODE ALL ANSWERS FIRST 
*. 
a 
RIGHT - ONE AT A TIME 

AS YOU MIGHT EXPECT, THE PHONETIC FUNCTION CAN BE USED IN CONJUNCTION 
WITH EITHER KEYWORD, ORDER OR BOTH. LET'S LOOK AT A COUPLE OF EXAMPLES 
OF THE USE OF PHONETIC ALONG WITH ORDER. 



FRAME 637 WILL HAVE PHONETIC AND ORDER ON, WITH A CORRECT ANSWER OF 
•PHONETIC ORDER.' 

TO VERIFY THE COMBINED OPERATION OF THESE FUNCTIONS, TYPE IN THE WORDS 

MISPELLED, AND IN THE WRONG ORDER - ' ORDOR PHOMETIC 

arder phenetical 

YOU MUST HAVE MISPELLED IT TOO BADLY. TRY AGAIN. 

orderhs phenitic 

YOU MUST HAVE MISPELLED IT TOO BADLY. TRY /GAIN. 
*. 

order phenetic 

GOOD - YOUR MISPELLED, OUT OF ORDER ANSWER WAS ACCEPTED. 

NOW FOR TKES EXAMPLE, WE WILL SEE WHAT HAPPENS WHEN PHONETIC AND 
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ORDER ARE TURNED ON IN THE MIDDLE OF THE GROUP 3. FRAME 6k0 WILL BE 
CONSTRUCTED LIKE THIS. (WITHIN THE GROUP 3): 
ORDER OFF 

PHONETIC OFF 
A+VERY GOOD 

1 ORDER ON 

1 PHONETIC ON 
B+VERY GOOD 

THIS MEANS THE PROGRAM WILL ATTEMPT TO FIRST MATCH 'VERY GOOD 1 WITH 
THESE FUNCTIONS OFF. SINCE WE WILL HAVE YOU INSERT AN ANSWER THAT IS 
OUT OF ORDER AND MlSPELLED, PT WON'T MATCH. YOUR ANSWER WILL MATCH 'B' 
HOWEVER, SINCE THE FUNCTIONS ARE TURNED ON AT THAT POINT. OK, MOW TYPE 
IN 'GOOD VARY' 

* 

good vary 

YOU ARE CLOSE, BUT YOUR SPELLING AND ORDER ARE OFF. TRY AGAIN, WITH 

* 

very good 

GOCD. YOUR SPELLING AND ORDER ARE CORRECT. 

AS YOU CAN SEE, YOUR FIRST ANSWER REQUIRED THE FUNCTIONS TO BE ON, AND 
MATCHED 'B\ YOUR SECOND ANSWER SHOULD HAVE MATCHED 'A 1 , SINCE IT DID 
NOT REQUIRE ORDER OR PHONETIC FOR A MATCH. 



SO MUCH FOR PHCWETIC AND ORDER NOW LET'S TRY PHONETIC AND KEYWORD. 
THIS MEANS THAT YOU CAN MlSFELL AND HAVE EXTRANEOUS vORDS IN YOUR 
ANSWERS, BUT YOU MUST INPUT WITHIN THE SPECIFIED SEQUENCE. FRAME 6UU 
HAS A GROUP 3 THAT LOOKS LIKE THIS: 
PHONETIC ON 

KEYWORD ON 
A+COMPUTER DIRECTED 

THE QUESTION IS 'CDTS 3TANDS FOR wHAT?' WE HAVE DECIDED THAT THE WORDS 
•COMPUTER UIRECTED 1 WILL SJFFICE FOR A CORRECT ANSWER, AND THAT WE DO 
NOT CARE IF YOU SpELL THEM FBOPERLY. 

FIRST TYPE IN 'DIRECTED COMPUTER'. IT WILL BE REJECTED SINCE THE ORDER 

IS BAD. then type IN 'computer dorected training*. 



directed computer 

NO, THAT'S NOT IT, TRY AGAIN. 
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conputer dorected training 

RIGHT - COMPUTER DIRECTED TRAINING SUBSYSTEM. 

SINCE YOU MATCHED 'COMPUTER DIRECTED', YOUR ANSWER v&S SUCCESSFULLY 

PHONETICALLY ENCODED, AND THE WORD 'TRAINING' WAS IGNORED BY KEYWORD. 

NOW FOR THE FINAL TEST, WE WILL TURN ALL THREE FUNCTIONS ON TOGETHER. 
FRAME 6h6 WILL EXPECT AN ANSWER OF 'PHONETIC KEYWORD ORDER'. INSERT 
THIS ANSWER IN ANY ORDER, WITH KEYWORD SPELLED AS 'KOIWARD', 
AND WITH EXTRA WORDS, SUCH AS 'IT MIGHT BE' 

i think it is phonetic koivaru arid the other is order 
HEY IT WORKS. 

IF YOU tOULD LIKE THY THAT IKFUT AGAIIv, WEfH OTHER EXTRANEOUS *KM\S t 
0}< WITH A DIFFERENT ORDER, JUST TYPE If; ?GCTO ALLON. OTHERWISE TYPE 
GO AND WE WILL WRAP UP THIS TOPIC. 



go 

OK, NOW FOR THE M FRAME GROUP 3 

GROUP 3 - M FRAME 

AS DISCUSSED DURING THE LESSON BUILDING DEMONSTRATION, THE GROUP 3 
WITHIN THE M FRAME INVOLVES THE PRINTING OF ANSWER CHOICES AT THE 
TERMINAL, AND MATCHING OF THE ANSWER TAG INSERTED BY THE TRAINEE WITH 
THE CHOICES AFFORDED HIM. 

THE SERVICE FUNCTIONS, PHONETIC, KEYWORD AND ORDER HAVE NO MEANING 
IN THE M FRAME, SINCE THE STUDENT IS EXPECTED To INPUT A SINGLE LETTER. 
IF THE COURSE DESIGNER INADVERTANTLY ATTEMPTS TO TURN ANY OF THESE 
FUNCTIONS ON, THEY WILL BE IGNORED. 

WITH THIS EXCEPTION, THE FUNCTIONING OF THE M FRAME GROUP 3 IS 
ESSENTIALLY THE SAME AS WITH THE wl FRAME. LET'S EXAMINE THE PROGRAMS 

PROCESSING OF DUPLICATE ANSWER TAGS, AND FRAMES CONTAINING A RANGE 
GOING FROM NO CORRECT ANSWERS TO ALL CORRECT ANSWERS. 

FRAME 651 PRESENTS TWO ANSWER CHOICES, BUT NEITHER IS TAGGED AS BEING 

CORRECT. (TYPE IN A SINGLE LETTER) 
A THIS ANSWER IS CORRECT 
B THIS ANSWER IS CORRECT 

* 

b 

WRONG, NEITHER ANSWER HAS BEEN TAGGED AS BEING CORRECT. 
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NOW LET'S LOOK AT A FRAME WITH ALL CORRECT ANSWERS. 

A THIS ANSWER IS CORRECT 

B THIS ANSWER IS CORRECT 

* w 

ab 

CHOOSE ONE OF THE ABOVE LETERS 

# 

b 

CHECK 

NOW LET'S SEE HOW M FRAMES MAY BE SPLIT BETWEEN GROUPS. YOU WILL NOTICE 
THAT WHEN THE M FRAME IS SPLIT AND THE STUDENT IS INSTRUCTED To TRY 
AGAIN, THE ANSWER CHOICES ARE PRINTED AGAIN. (WHICH DOESN'T HAPPEN 
WHEN A SINGLE M FRAME CONTAINS ALL FOUR GROUPS). THIS HAPPENS BECAUSE 
THE PROGRAM HAS TO BACK UP AND RETRIEVE THE GROUP 3 FOR: 
A A SECOND ATTEMPT AT MATCHING (THIS IS CORRECT, BUT DON'T SELECT IT) 
B THE PROGRAM IS CONFUSED (SELECT THIS ONE FIRST) 
C THERE IS NO REAL REASON (SELECT THIS ONE SECOND) 
* # 

b 

WRONG, TRY AGAIN 

A A SECOND ATTEMPT AT MATCHING (THIS IS CORRECT, BUT DON'T SELECT IT) 
B THE PROGRAM IS CONFUSED (SELECT THIS ONE FIRST) 
C THERE IS NO REAL REASON (SELECT THIS ONE SECOND) 

cc 

WRONG AGAIN, BUT YOU WERE TOLD TO DO THIS. 

NOW LET'S SEE WHAT HAPPENS WHEN YOU ATTEMPT To INPUT SOMETHING OTHER 
THAN ONE OF THE ANSWER CHOICES PRESENTED TO YOU. (TYPE IN ANYTHING BUT 
A OR B THE FIRST TIME. YOU WILL BE INSTRUCTED TO 'CHOOSE ONE OF THE 
ABOVE LETTERS). 

A THIS IS RIGHT ANSWER 
B THIS IS WRONG ANSWER 

d 

CHOOSE ONE OF THE ABOVE LETTERS 
*^ 

a 

RIGHT, THAT WAS THE RIGHT ANSWER 

THIS CONCLUDES THE DEMONSTRATION OF GROUP 3 PROCESSING. THE GROUP k FOR 

D AND M FRAMES (USED FOR SETTING OF ITEMS FOR USE WITHIN DECISION 

FRAMES; PRINTING OF THE CORRECT ANSWER; AND BRANCHING TO ANOTHER FRAME 

OR CUES TO RESPOND AGAIN TO THE JAME FRAME) MAS ALREADY BEEN wtiMON- 

STRATED IN DETAIL WHEN WE VERIFIED THE JWOCKSSINQ vF THE GROUP 3. 
*£BBSR THAN REPEATING A TEST OF THE GROUP k, WE WILL GO BACK AND 
COMPARE THE PRINTOUTS OF YOUR PATH THROUGH THIS LESSON WITH THE LISTING 
OF THE LESSON THAT WAS PRODUCED BY OFF-LINE LESSON BUILDING. 
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THE PROCESSING WE WILL VERIFY IS SPECIFIED ON PAGES k2-kk OF 

THE TEST PLAN. IF YOU WOULD RATHER DO THIS AT A LATER TIME, TYPE IN 

GO ON, AND WE SHALL MOVE DIRECTLY TO A DEMONSTRATION OF THE TRAINEE 
RECORD PROCESSING FUNCTION. 



go on 
OK 
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IN THE ABOVE SEQUENCE, THE AF-STUDENT WITH THE TR-ID OF 123^56,-89 
ENTERED LESSON DEMO AT FRAME 1.00 WHICH WAS A MULTIPLE- CHOICE FRAME. 
ENTERING THE ANSWER 'A' HE WAS BRANCHED BY THE PROGRAM TO FRAME 31.00 
WHERE TEXTUAL MATERIAL WAS PRESENTED FOR WHICH A STUDENT RESPONSE WAS 
NOT REQUIRED. 



THIS IS INDICATED BY THE ABSENCE OF ANY DATA IN THE ANSWER AND 
RIGHT/WRONG COLUMNS. 

THE STUDENT PROCEEDS WITHIN THE LESSON (MISSING FRAME 32.0/' THE FIRST 

TIME) UNTIL HE ENTERS THE DECISION FRAME 33.50. 
THE RIGHT ANSWER FOR FRAME 32.00 AS INDICATED IN THE TRAINEE RECORD 
PRINTOUT IS: 

A D 
B C 
C B 

D A 

* 

c 

NO, THAT IS A WRONG ANSWER. LOOK AT THE TRAINEE RECORD AND 

TRY AGAIN. 

* 

b 

VERY GOOD. 

WITHIN THE DECISION FRAME, THE STUDENT MEETS A PARTICULAR CONDITION AS 

ESTABLISHED BY THE COURSE DESIGNER AND IS BRANCHED TO FRAME 52.00. 



HAVING TROUBLE WITH THIS FRAME, AS INDICATED BY THREE REPETITIONS, THE 
STUDENT USES THE GOTO OPTION AT FRAME 53.00 TO BRANCH TO A FRAME LABEL 
CONTAINED WITHIN FRAME 69.00. 

THE STUDENT CONTINUES WITHIN THE LESSON UNTIL FRAME 78. <0. AT THIS 
POINT HE IS BRANCHED BACK TO FRAMES 65-50 AND 66.00 FOR A BRIEF REVIEW. 

HAVING SUCCESSFULLY 'PASSED' THESE TWO ITEMS, THE STUDENT IS BROUGHT 
BACK TO THE MAIN PATH OF THE LESSON. 

FRAME 78.3 IS A; 

A Q 

B M 

C D 

D C 

*. 

b 

YES. IT IS A M FRAME 
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THE STUDENT COMPLETES THE LAST FRAME OF THIS ILLUSTRATIVE LESSON AS 
INDICATED BY THE OPTION DONE. THE STUDENT NOW HAS THE OFTION TO 
CLOSE THE SESSION OR REQUEST ANOTHER LESSON. 

FOLLOWING THE LISTING OF THE STUDENTS FRAME BY FRAME PREFORMANCE, 
THE PROGRAM SUMMARIZES AND PRINTS THE NUMBER OF RIGHT, WRONG, 
UNANTICIPATED AND TOTAL NUMBER OF RESPONSES 

THE TOTAL NUMBER OF RIGHT RESPONSES IS: 

* 

11 

YES, 11 CORRECT RESPONSES. 

THE TOTAL NUMBER OF UNANTICIPATED RESPONSES WAS: 

* 

• 

one 

YES, ONLY ONE UNANTICIPATED. 

THE TOTAL NUMBER OF WRONG RESPONSES IS k. THE NUMBER OF UNANTICIPATED 

RESPONSES IS PART OF THIS TOTAL. THESE TWO CATEGORIES PLUS THE NUMBER 

OF RIGHT RESPONSES FORMS THE BASIS OF THE TOTAL RESPONSES. * 

THE TOTAL NUMBER OF RESPONSES THIS STUDENT MADE WAS: 

* 

15 

RIGHT— 15 

LESSON CONCLUDED- ENTER COMMAND 
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The 
On- 



OFF -LINE /ON-LINE PRINTOUTS OF TEST--OFLINE 

Off-Line printout of the test--OFLINE is presented first, followed by the 
Line printout obtained by executing the test vehicle . 



The Off- Line printout indicates the content of the test, depicting the various 
error conditions and associated messages which were specified to occur. The 
On- Line printout indicates that all error conditions were corrected and the test 
regenerated in an "error free" condition. 
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F Pi A m f: listing and associated error messages 



FRAME 1.0 TYPE Q LABFL ST AH T 

G.2 TEXT 

1.0 OFF-LINE LESSON BLILOING DEMON S T R AT I ON ? 

2,0 THE PLRPOSE OF THIS DEMONSTRATION IS TO ILLUSTRATE SOME OF 1 HE ERRUK 
I.Q.. CCNDIUCN.S- AND .itABiLlALfi . MESSAGE i WHICH MAY OCCUR WHEN BUILDING A 
1.0 LESSON USING THE OFF-LTNE LESSON BUILDING MODE OF THE CDTS.? 

FRAME 2.C TYPE LABEL 

G.2 TEXT 

1,0 THIS LESSON DECK WILL BE PROCESSED AND THE ERROR CONDITIONS INDICATED 
2,0 AS A COPY OF ThE LESSON IS OUTPUT ON THE LINE PRIMER, THE ERROR 
3.0 MESSAGF IS EASILY SPOTTED AS IT IS FOLLOWED BY SEVERAL *** (ASTERISKS) 
1.0 WHICH EXTEND dEYOKD THE NORMAL TEXT BOUNDARIES (72 COLUMNS),? 

FRAME 3.C TYPE (J LABEL 

G,2 TFXT 

l.C EACH CARD rtlThlN THIS LESSON CECK WHICH CAUSES AN ERHOK CONDITION TO 
2.C OCCUR WILL BE MflRKEC WITH A NLMBER FOR IDENTIFICATION PURPOSES, THESE 
3.0 NUMBERS.^ ILL BE .SE-O.U.EM IAL a.3 
1.0 A SECOND DECK OF CAROS HAVE HFEN PREPAREO WHICH CONNECTS A GIVEN ERROH 

FRAME 4.0 TYPE <J LABEL 

G, 2 TEXT 

1.0 CONDITION. THESE ERROR CORRECTION CARDS AKE ALSO CODED. EACH 

2,0 CAPO WILL HAVE A NUMBER' WHICH MATCHES A NUMBER IN I HE LESSON DECK* 

3,0 PLUS A LET TEH.? 

FRAME . 5,0 . TYPE Q .LABEL 

G,2 1EXT 

1.0 FCH EXAMPLE!? 

2,0 ERROR CORRECTION CAROl 5A REPLACES 

3.C LESSON DECK CARDS 1? 

1,0 E.R.HO.R CCRRLCTJCN. CARU«._ 4 A REPLACES 

5,0 LESSON DECK~ CARD" J 4? 
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FRAME 6.0 TYPE LABEL 

G.2 TEXT 

l.C IF M.QR.E THAN GNt EHRjOR CORRECTION CARD IS NEEDED TO CORRECT A SPECIFIC 

2,0 FRHCR CONDITION* IT WILL BE INDICATED BY hAvlNG THE SAME NUMBER 

3.C FOLLOWED BY A DIFFERENT LETTER,? 

4,0 (I.E.* 6 A A N C 6B OH 1 C A * 1 H » AND IOC), 

FRAME _7.iJD.._IYEE. a ... .LAdEL-ERRQJU. ....._ 

G»2 TEXT 

1,0 THF FIRST ERROR CONDITION ILLLSTRATEO WlLLbE EXCEEDING FRAME 

2,0 CAPACITY, THE LEGAL LIMIT OF ChARACTERS WlTRlN A FRAME [S 400,? 

3,0 THIS IS PROBABLY THE MOST COMMON ERROR AND REQUIRES THAT THE COURSE 
... A»0.„._QE.SJ.GMfi. SPLIT.. .L.HJ.„XQNTENIS. OF THE FRAME INTO ONE OK MORE FRAMES. THIS 

5.0 CAN USUALLY BE DONE BY PUTTING GROUP 3 AND 4 INTO A SEPARATE FRAME.? 

FRAME CAPACITY REACHED, REMAINING CAhOS REJECTED FRAME 7,0 *********** 

FRAME 7.7 TYPE Q LABEL 

G.2 7FXT 

1.0 THE NEXT ERROr< CONDITION WILL POINT OUT ThAT THE PHOGRA* HILL NOT 
2,C TOLERATE DUPLICATE FRAME NUMBERS.? 

DUPLICATE FRAME NUMdEHS *ERE INPUT. THE ENTIRE FRAME HAS REJECTED FRAME 

FRAME 9.0 TYPE G LABEL 

G.2 TExV 

1,0 IN THE NEXT TwO FRAMES WE wILL ILLUSTRATE A FRAME NUMBER ERROR, 

2.C FOLLOWED BY An ILLEGAL FRAME TYPE. 
024ABC FRAME NUMBER E9.RQK ************************************************ *l 

ILLEGAL FRAME TYPE - 'Qt' WAS INSERIEC FOR FRAME 11.0 ******************* 

FRAME 11.0 TYPE Ql LABEL ERR0R4 

G.2 TFXT 

1.0 AGAIN* BY REPLACING LESSON CARD LABELLED 4 wITR ERROR COHRECIION CARD 
2.0 4A, A PROPER FRAME TYPE"-«* m, CR C wAS INSERTED,? 

3,C THE PROGRAM AUTOMATICALLY INSERTS A •«• TYPE FRAME KHICH MUST BE 
4,C CHANGED IF A '0' QR *M» TYPE FRAME WAS WANTED,? 
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ILLEGAL DECISION STATEMENT FOR FRAME 12,0 *********************************** 

FR-AilE 12..0... TYRE LA.B£L E.HRQR5 ._- 

G..2 CONDITIONS 

1,0 KINRW LET'S ILLUSTRATE A DECISION FRAME ERROR. THE KUUHTH LINE OF THIS 
2.0 Ft»D» FRAME WILL BEGIN w I IK SOMETHING OTHER THAN IF* ANO» QK» ELSE* 
3.0 F:end# F:» b»# OR S « .? 

FRAME 13.0 TYPE Q LABEL 

G.2 TFXT 

1,0 TF CARDS WITHIN A PARTICULAR GROUP BECOME t IN TER M I NGLE D WITH THE CAROS 1 
.2.0. QF ANOTHER GROUP' J HE PHQyR AJL OuT PUT S AN APPROPRIATE ERROR MESSAGE. 2 

FRAME 13.5 TYPE Q LABEL ERR0R6 

* G.2 TFXT 

1.0 REORDER THE CARDS -.NUMBEh ON JH.E RIGHT TO CORRECT [HE ERROR ANU 3 

2.C TYPE GO. 1 

G.A ACTIONS 

1 .0 A F J 6 

OOPLICATE FRAME NUMB^HS WERE INPUT. THE EMIRE FRAMF. WAS REJECTED FRAME 1 3 . J 

FRAME 14.0 TYPE M LABEL ERRQR7 

G.2 TEXT 

1.0 THIS CONDITION CAN ALSO OCCUR IF A BLANK CAnO IS INADVERTENTLY PLACED 
2.0 BETWEEN THE CARDS WlTHItv A GROUP OR BETWEEN GROUPS. 

G,3 ANSWERS 

1.0 A4AFTER REMOVING THE N F X f CARD 

OL'HIICATE FRAME NUMBERS WEBE INPUT. I HE ENTIRE FRAME WAS REJECTED FRAME 1 4 . t 



T 
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ILLEGAL FRAME LABEL F OR FRAME 15:. C *************************************** 

FRAME 15. C TYPE_Q u/lflEL .. 

G,2 TEXT 

l.C THIS FRAME MUST HAVE THE LABEL CORRECTED. ThE LABEL INSERTED MS 
?.0 'GOTO' HHICH IS RESTRICTED FRCM USE AS A LAoEL BY CUTS AS ARE ALL 
3,0 CCMMANOS/OPTTUNS.? 
.A.O .REPLACE THE.L£S.S.OJi„C.ARO HMlt£C .6 UlTH THE ERROR CORRECTION CARO 8A.? 

REDUNDANT! LABEL IN USE AT FRAME 1.0 FOR FRAME 16.0 ********************* 

.FRAME 16.. 0. TYPE. Q. .LABEL ..._.„ 

G,2 TEXT 

1.0 ANOTHER TYPE OF ERROR CONDITION WHICH CAN OCCUR IS INSERTING A 

2,0 DUPLICATE LA8EL, THIS IS NG1 ALLOWED BY COTS SINCE THE PHUGRAM WOULD 

3,0 NOT KNOW WHTCh LABEL TO B*Af\CH OR GOTO IF HtOUIREO.7 

4.0 T H.I S FRAME. HAS. lHL>3Afl£ LAdfcJ. AS FRAME 1,00, REPLACE CARU 9 WITH 

b.C CARO 9A.7 

FRAME 17.0 TYPE H LABEL 

G,.2 TEXT 

1.0 THF PROGRAM PERFORMS CERTAIN CHECKS CONCERNING THE THREE SERVICE 
2.0 FUNCTIONS. 

G.3 ANSWERS 

1.0 A*PHONETIC 
2.C JJ + URQER. 
3.0 C+KEYWORO 

G.4 ACTIONS 
1 .0 ABC F J 

SERVTCF FLNCTION INPUT FOR M e R A M f FRAME 16, **************************** M 
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FRAME 18. C TYPE M LABEL ERR1C 

G, 2 TEXT _ __ 

l.c'V WARNING MESSAGE IS OUTPUT WHEN A SERVICE FUNCTION IS INSERTtD W I I H I N 
2.0 A MULIIPLE-CHCICE FKAME. wH.EN THIS HAPPENS THE FRAME SHOULD BE EXAMINED 
3.0 TO DETERMINE IF THE FRAME TYPE SHCULO RE AN »m* OH wHFHE ThE FUNCTION 

G.3 ANSWERS 

.1*0 K.IYHQ_RD.. ON . _..,. _ ...... .. . 

2.0 A* WAS DESIRED. 

3.0 B REMOVE 

l.C C CARD 10 

b.G TO CORRECT THE FRAME. 

G.l ACTIONS 

1 .0 A F I 
2.0 HCO Fl 



SERVICE FUNCTION REJECTED K C R FKAME 15,0 +*+************ + ***** + ********** + y 

PRAme 19.. Q. TYPE « L.A]3EU ERR11. 

G , 2 T E X T 

1,0 WHEN THE SERVICE FUNCTIONS ARE INSERTED wlThlN A iq« FRAME* CUTS CHECKS 

2.C TO INSURE THAT [HE FORMA! IS CORRECT.? 

3.C THIS FRAME HAO-0 KEYRCAHO ON" INSERTED. REPLACE CAHO 11 *ITH CARD UA.? 

'1,0 TYPE GC TO CONTINUE, 

G.J ANSWERS 
1 .0 AGO 

G . A ACTIONS 

.1.0 A F.J.FINE 

2.0 -FtLET' GO. 

FRAME 20. C TYPE Q LABEL 

G,2 TEXT _ 

1,0 THE PROGRAM ALSO CHECKS ThE SERVICE FUNCTION STATEMENT TO INSURE? 

2.0 IT STARTS WITH A NOMdER C-9> 

3.C IF SE! IS USED* OFFSET WITH BLANKS' 

A.U IS ESTABLISHED AS ON OR OFF,? 
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, FRAME 23.0 TYPE Q LABEL 

G.2 TEXT 

l.C THE NEXT ERROR CONDITION « ILL BE MENTIONED BUT NOT UE MOn S T R A T ED , ? 
2,0 THE" MAXIMUM NUMBER OF FRAMES ALLOWED PER LESSON IS 300. IF THIS 
3,0 LIMJT I.S E_ X C E E O.EJLl _C T S_ rfj L L_ INQIC ATE:? 
fl . C ' D~I R E C I R Y TABLE IS FULL. REMAINING FRAMES ARE REJECTED.? 

FRAME 24,0 TYPE Q LABEL 

G..2 TEXT _ 

l.C THE FRAMES PREVIOUSLY GENERATED MLST BE DELtTEO OR ANOTHER LESSON DECK 
2.0 MUST BF ESTABLISHED, .l.F . IhE. RE JEC T E D ►R.AMES ARE DESIRED..? ,. 

FRAME 25. C TYPE U LABEL END 

G.2 TEXT 

1.G...T.HI.S CONCLUDES I.H£ CFf -LIAE. . -CE&ENS T RA T I ON OF ERROh CONDITIONS AND 

2.C WARNING MESSAGES.? 

3.C IF ALL CORRECTIVE ACTIONS WERE TAKEN, THIS LESSON SHOLLD NOW BE FREE 

l.C FROM ERRORS. I Y P S • EXCEPT THESE ChECkED BY THE COTS, MOST BE 

•3.C CAUGHT BY THF COURSE DESIGNER. 



r 
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?get of line Sb 
069169 

OFF-LINE LESSON BUILDING DEMONSTRATION 



THE PURPOSE OF THIS DEMONSTRATION 3S TO ILLUSTRATE SOME OF THE EROR 
CONDITIONS AND WARNING MESSAGES WHICH MAY OCCUR WHEN BUILDING A 
LESSON USING THE OFF-LINE LESSON BUILDING MODE OF THE CDTS. 



THIS LESSON DECK WILL BE PROCESSED AND THE EROR CONDITIONS INDICATED 
AS A COPY OF THE LESSON IS OUTPUT ON THE LINE PRINTER. THE ERROR 
MESSAGE IS EASILY SPOTTED AS IT 15 FOLLOWED BY SEVERAL *** (ASTERISKS) 
WHICH EXTEND BEYOND THE NORMAL TEXT BOUNDARIES (72 COLUMNS). 

EACH CARD WITHIN THIS LESSON DECK WHICH CAUSES AN ERROR CONDITION TO 
OCCUR WILL BE MARKED WITH A NUMBER FOR IDENTIFICATION PURPOSES. THESE 
NUMBERS WILL BE SEQUENTIAL. 

A SECOND DECK OF CARDS HAVE BEN PREPARED WHICH CORRECTS A GIVEN ERROR 
CONDITION. THESE ERROR CORRECTION CARDS ARE ALSO CODED. EACH 
CARD WILL HAVE A NUMBER, WHICH MATCHES A NUMBER KT THE LESSON DECK, 
PLUS A LETTER. 

FOR EXAMPLE: 

ERROR CORRECTION CARD: 1A REPLACES 
LESSON DECK CARD: 1 

EROR CORECTION CARD: UA REPLACES 
LESSON DECK CARD: k 

IF MORE THAN ONE ERROR CORRECTION CARD IS NEDED TO CORRECT A SPECIFIC 
ERROR CONDITION, IT WILL BE INDICATED BY HAVING THE SAME NUMBER 
FOLLOWED BY A DIFFERENT LETTER. 

(I.E., 6A AND 6B OR 10A, 10B, AND 10C). 
THE FIRST ERROR CONDITION ILLUSTRATED WILL BE EXCEEDING FRAME 
CAPACITY. THE LEGAL LIMIT OF CHARACTERS WITHIN A FRAME IS k00. 

THIS IS PROBABLY THE MOST COMMON ERROR AND REQUIRES THAT THE COURSE 
DESIGNER SPLIT THE CONTENTS OF THE FRAME INTO ONE OR MORE FRAMES. THIS 
CAN USUALLY BE DONE BY PUTTING GROUP 3 AND h INTO A SEPARATE FRAME. 

THE PARTICULAR FRAME SHOULD BE EXAMINED TO SEE EXACTLY WHAT MUST BE 
DONE. 



329 Page 330 blank 



THE LAST FOUR LINES SHOULD NOW BE IN FRAME 7.5 AFTER THE ERROR 
CORRECTION CARDS 1A AND 1B HAVE BEEN INSERTED. 

THE NEXT ERROR CONDITION WILL POINT OUT THAT THE PROGRAM WILL NOT 
TOLERATE DUPLICATE FRAME NUMBERS. 

THE DUPLICATE FRAME NUMBER ERROR (FRAME 6.0 TWICE) SHOULD NOW BE 
CORRECTED AFTER ERROR CORRECTION CARD 2A IS INSERTED AND THIS FRAME 
SHOULD NOW BE FRAME 8.0. 



IN THE NEXT TWO FRAMES WE WILL ILLUSTRATE A FRAME NUMBER ERROR, 
FOLLOWED BY AN ILLEGAL FRAME TYPE. 

AFTER REPLACING LESSON CARD LABELLED 3 WITH ERROR CORRECTION CARD 3A, 
THE CORECT FRAME NUMBER— 10.0 SHOULD BE ACCEPTED. 

AGAIN, BY REPLACING LESSON CARD LABELLED k WITH ERROR CORECTION CARD 
kA, A PROPER FRAME TYPE— Q, M, OR D WAS INSERTED. 

THE PROGRAM AUTOMATICALLY INSERTS A 'Q' 1YPE FRAME WHICH MUST BE 
CHANGED IF A 'D' OR 'M' TYPE FRAME WAS WANTED. 

NOW LET'S ILLUSTRATE A DECISION FRAME ERROR. THE FOURTH LINE OF THIS 
'D' FRAME WILL BEGIN WITH SOMETHING OTHER THAN IF, AND, OR, ELSE, 
END, 



IF CARDS WITHIN A PARTICULAR OROUP BECOME INTERMINGLED WITH THE CARDS 1 
OF ANOTHER GROUP, THE PROGRAM OUTPUTS AN APPROPRIATE ERROR MESSAGE. 2 
REORDER THE CARDS -NUMBER ON THE RIGHT TO CORECT THE ERROR AND 3 

TYPE GO. h 

* 

. 

go 

LET'S PROCED ANYWAY 7 

THIS CONDITION CAN ALSO OCCUR IF A BLANK CARD IS IRADVERTENTLY PLACED 

BETWEEN THE CARDS WITHIN A GROUP OR BETWEEN GROUPS. 

A AFTER REMOVING THE NEXT CARD 

B THE FRAME WILL 

C SIMULATE A LEGAL 

D MULTIPLE -CHOICE FRAME. INSERT A LETTER 

*. 

T> 

NOT SO 

THIS FRAME MUST HAVE THE LABEL CORRECTED. THE LABEL INSERTED WAS 

'GOTO' WHICH 15 RESTRICTED FROM USE AS A LABEL BY CDTS AS ARE ALL 

COMMANDS/OPTIONS. 
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REPLACE THE LESSON CARD MARKED 8 WITH THE ERROR CORRECTION CARD 8A. 

ANOTHER TYPE OF ERROR CONDITION WHICH CAN OCCUR IS INSERTING A 
DUPLICATE LABEL. THIS IS NOT ALLOWED BY CDTS SINCE THE PROGRAM WOULD 
NOT KNOW WHICH LABEL TO BRANCH OR GOTO IF REQUIRED. 

THIS FRAME HAS THE SAME LABEL AS FRAME 1 .00. REPLACE CARD 9 WITH 
CARD 9A. 

THE PROGRAM PERFORMS CERTAIN CHECKS CONCERNING THE THREE SERVICE 

FUNCTIONS. 

A PHONETIC 

B ORDER 

C KEYWORD 

*. 

c 

GOOD 

A WARNING MESSAGE IS OUTPUT WHEN A SERVICE FUNCTION IS INSERTED WITHIN 

A HJLTIPLE -CHOICE FRAME. WHEN THIS HAPPENS THE FRAME SHOULD BE EXAMINED 

TO DETERMINE IF THE FRAME TYPE SHOULD BE AN 'M 1 OR WHERE THE FUNCTION 

A WAS DESIRED. 

B REMOVE 

C CARD 10 

D TO CORECT THE FRAME. 

* 

. 

a 

VERY GOOD 

WHEN THE SERVICE; FUNCTIONS ARE INSERTED WITHIN A 'Q' FRAME, CDTS CHECKS 

TO INSURE THAT THE FORMAT IS CORRECT. 



THIS FRAME HAD-0 KEYBOARD ON- INSERTED. REPLACE CARD 11 WITH CARD 11 A. 

TYPE GO TO CONTINUE. 

*. 

go t o 

FINE 

THE PROGRAM ALSO CHECKS THE SERVICE FUNCTION STATEMENT TO INSURE 

IT STARTS WITH A NUMBER 0-9, 

IF SET IS USED, OFFSET WITH BLANKS, 

IS ESTABLISHED AS ON OR OFF. 

THE NEXT EROR CONDITION WILL BE MENTIONED BUT NOT DEMONSTRATED. 
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THE MAXIMUN NUMBER OF FRAMES ALLOWED PER LESSON IS 300. BP THIS 
LIMIT IS EXCEEDED, CDTS WILL INDICATE: 

DIRECTORY TABLE 33 FULL. REMAINING FRAMES ARE REJECTED. 

THE FRAMES PREVIOUSLY GENERATED MUST BE DELETED OR ANOTHER LESSON DECK 
MUST BE ESTABLISHED. IF THE REJECTED FRAMES ARE DESIRED. 

THIS CONCLUDES THE OFF-LINE DEMONSTRATION OF ERROR CONDITIONS AND 
WARNING MESSAGES. 



IF ALL CORRECTIVE ACTIONS WERE TAKEN, THIS LESSON SHOULD NOW BE FREE 
FROM ERRORS. TYPOS, EXCEPT THOSE CHECKED BY THE CDTS, MUST BE 
CAUGHT BY THE COURSE DESIGNER. 
LESSON CONCLUDED-ENTER COMMAND 
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SAMPLE TRAINEE RECORD 

A trainee record was selected from the total number of trainee records processed 
after the first day of Formal Qualification Testing (16 June 1969). 

This is a partial trainee record as the user did not complete the "lesson" DEMO01, 
The CDTS option GOTO was used three times as indicated by the printout. There 
were 28 responses required in this sequence with the user responding correctly 
to 21. Of the seven incorrect responses, four were anticipated by the course 
designer and included within the body of the frames, whereas three were processed 
as unanticipated. 

This record of trainee performance reflects approximately one hour of on-line 
interaction. 
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LFSSOKI-NAME 


OFMH01 


TRAINFF 


OPTTDM 


FRA^E 


'TYPE 




001 .0 


Q 




On?,0 


M 




003.0 


Q 




ooa.o 


Q 




005.0 


Q 




006.0 


• Q 




007.0 







008.0 


Q 




009.0 


Q 




010.0 


M 




01 1 .0 


Q 




OTP.O 


" "0 




01 3.0 


9 




01 4.0 


Q 




015.0 


« 




016.0 


Q 




01 7.0 







018.0 


"0 




019.0 







090.0 


M 




0?1.0 


M 




092.0 







018.0 


Q 




01 9.0 


Q 




070.0 


M 




091 .0 


M 




0?4.0 







075.0 


M 




'J 9 . 


Q 




0*07*0 


Q " 




051.0 







0*2.0 







0*3.0 







0*4.0 







0*5.0 


Q 


* 


0*6.0 


W 




0*7.0 


Q 




0*8. 







0*9.0 


Q 




074.5 


Q 




075.0 


9 



UNCLASSIFTEO 
TNDTVTDUAL HISTORY 

NAME.' STEVENSON TR-ID 500361*87 

ANSWER RIGHT/WRONG 

A + 



C *' 

R ♦ 

A ♦ 
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076.0" 

077.0 

078.0 

079.0 

080.0 

081 .0 

08 1 .3' 
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LESSON-NAmE DEM001 
OPTION TpAW 



Q 

Q 
M 




A 
A 
B 

UNCLASSIFIED 



PAGE 001 



unclassified 
individual history 
trainee name stevenson 
"Type *ns'wfr 



i 



TR-ID_500361587 

RrGHTTWnNr, 



f 



0«1 .6 

0*1 .8 

03?. 

0A3.0 

083.5 

0«A.O 

U«4.5 

0«5.0 

0*5.5 

0*6.0 

0*6.5 

087.0 

OP, 7. 5 

0*8.0 

088.5 

U « 9 . T) 

0*9.5 

000.0 

090.5 

001 ,0 

001 .5 

1*0.0 

101 .0 

102 

103 

104 

105 



M 
Q 
Q 
Q 

Q 

G 
M 



Q 
Q 

M 
M 
Q 
Q 
Q 



& 
Q 





A 
A 

A 
A 






+ 
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GOTH 



GOTO 



GOTO 



106.0 
107.0 
108.0 
109.0 
110.0 
111.0 
111.5" 
112.0 
11 3.0 
113.0 
1 1 fl.O 
115.0 
113.0 
114,0 
1 1 6.0 



Q 
Q 
Q 
* 
9 
Q 


a 

Q 

o 

o 
o 



i 

s 



TOTAL NUMRER OF 

TOTAL NUMRER OF 

TOTAL NUMRER OF 

TOTAL NUMRER OF 



RIGHT RFSPONSFS 021 

WPONG RFSPONSFS 007 

UMANTTCTPATEO RESPONSES 003 

RrsPONSES 028 
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